Jul 06 20:58:12 devstack cinder-volume[75991]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 20:58:12 devstack cinder-volume[75991]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 20:58:12 devstack cinder-volume[75991]: we strongly recommend against using it for new projects. Jul 06 20:58:12 devstack cinder-volume[75991]: If you are already using Eventlet, we recommend migrating to a different Jul 06 20:58:12 devstack cinder-volume[75991]: framework. For more detail see Jul 06 20:58:12 devstack cinder-volume[75991]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 20:58:12 devstack cinder-volume[75991]: import eventlet # noqa Jul 06 20:58:15 devstack cinder-volume[75991]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 20:58:15 devstack cinder-volume[75991]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 20:58:15 devstack cinder-volume[75991]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 20:58:15 devstack cinder-volume[75991]: INFO dbcounter [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Registered counter for database cinder Jul 06 20:58:15 devstack cinder-volume[75991]: DEBUG oslo_db.sqlalchemy.engines [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:58:16 devstack cinder-volume[75991]: DEBUG dbcounter [-] [75991] Writer thread running {{(pid=75991) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:58:16 devstack cinder-volume[75991]: INFO cinder.rpc [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 20:58:16 devstack cinder-volume[75991]: INFO cinder.rpc [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 20:58:16 devstack cinder-volume[75991]: DEBUG oslo_db.sqlalchemy.engines [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:58:16 devstack cinder-volume[75991]: INFO cinder.volume.manager [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Determined volume DB was empty at startup. Jul 06 20:58:16 devstack cinder-volume[75991]: DEBUG cinder.volume.manager [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75991) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 20:58:16 devstack cinder-volume[75991]: INFO cinder.volume.manager [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 20:58:16 devstack cinder-volume[75991]: WARNING stevedore.named [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 20:58:16 devstack cinder-volume[75991]: WARNING castellan.key_manager [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:58:16 devstack cinder-volume[75991]: WARNING cinder.keymgr.conf_key_mgr [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:58:16 devstack cinder-volume[75991]: DEBUG cinder.volume.drivers.lvm [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75991) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}} Jul 06 20:58:16 devstack cinder-volume[75991]: DEBUG oslo_concurrency.processutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_concurrency.processutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] CMD "cinder-rtstool verify" returned: 0 in 0.610s {{(pid=75991) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_db.sqlalchemy.engines [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:58:17 devstack cinder-volume[75991]: INFO cinder.rpc [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Jul 06 20:58:17 devstack cinder-volume[75991]: INFO cinder.rpc [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Jul 06 20:58:17 devstack cinder-volume[75991]: WARNING stevedore.named [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 20:58:17 devstack cinder-volume[75991]: WARNING castellan.key_manager [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 20:58:17 devstack cinder-volume[75991]: INFO cinder.volume.manager [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_db.sqlalchemy.engines [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75991) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:58:17 devstack cinder-volume[75991]: INFO oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Starting 1 workers Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Started child 76158 {{(pid=75991) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Full set of CONF: {{(pid=75991) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] ******************************************************************************** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Configuration options gathered from: {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 20:58:17 devstack cinder-volume[76158]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] ================================================================================ {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] allow_availability_zone_fallback = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] allow_compression_on_image_upload = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] allowed_direct_url_schemes = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] api_rate_limit = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] auth_strategy = keystone {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] az_cache_duration = 3600 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_availability_zone = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_host = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_stats_polling_interval = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backup_api_class = cinder.backup.api.API {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backup_name_template = backup-%s {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backup_use_same_host = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backup_use_temp_snapshot = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] chap_password = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] chap_username = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_internal_tenant_project_id = 8a35397beacb4cf3b92d396602117f44 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_internal_tenant_user_id = 3c6bf7171305436f9c99ea0dae90024e {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cloned_volume_same_az = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cluster = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] compression_format = gzip {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] compute_api_class = cinder.compute.nova.API {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] config_dir = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] config_source = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] control_exchange = openstack {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] debug = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] default_availability_zone = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] default_group_type = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] default_volume_type = lvmdriver-1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] disk_geometry = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] driver_client_cert = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] driver_client_cert_key = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] driver_data_namespace = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] driver_ssl_cert_path = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] driver_ssl_cert_verify = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] driver_use_ssl = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] enable_force_upload = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] enable_new_services = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] enable_unsupported_driver = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] enforce_multipath_for_image_xfer = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] filter_function = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_api_insecure = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_api_servers = ['http://192.168.122.4/image'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_api_ssl_compression = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_ca_certificates_file = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_catalog_info = image:glance:publicURL {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_num_retries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance_request_timeout = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] goodness_function = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] graceful_shutdown_timeout = 5 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] group_api_class = cinder.group.api.API {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] host = devstack {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_compress_on_upload = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_conversion_address_space_limit = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_conversion_cpu_limit = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_conversion_disable = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_upload_use_cinder_backend = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_upload_use_internal_tenant = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_volume_cache_enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_volume_cache_max_count = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] image_volume_cache_max_size_gb = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] init_host_max_objects_retrieval = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] instance_format = [instance: %(uuid)s] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] iscsi_target_flags = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] iscsi_write_cache = on {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] iser_helper = tgtadm {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] iser_ip_address = 192.168.122.4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] iser_port = 3260 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_color = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_config_append = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_dir = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_file = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_options = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_rotate_interval = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_rotate_interval_type = days {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] log_rotation_type = none {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] max_age = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] max_logfile_count = 30 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] max_logfile_size_mb = 200 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] max_over_subscription_ratio = 20.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] message_reap_interval = 86400 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] message_ttl = 2592000 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] migration_create_volume_timeout_secs = 300 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] monkey_patch = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] monkey_patch_modules = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] my_ip = 192.168.122.4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] no_snapshot_gb_quota = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] num_iser_scan_tries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] num_shell_tries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] num_volume_device_scan_tries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[76158]: INFO cinder.volume.manager [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Starting volume driver LVMVolumeDriver (3.0.0) Jul 06 20:58:17 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] nvmeof_conn_info_version = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] nvmet_ns_id = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] nvmet_port_id = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] osapi_max_limit = 1000 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] osapi_volume_ext_list = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] osapi_volume_listen_port = 8776 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] osapi_volume_use_ssl = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] osapi_volume_workers = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] per_volume_size_limit = -1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] periodic_fuzzy_delay = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] periodic_interval = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] public_endpoint = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] publish_errors = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] quota_backup_gigabytes = 1000 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] quota_backups = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] quota_gigabytes = 1000 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] quota_groups = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] quota_snapshots = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] quota_volumes = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] rate_limit_burst = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] rate_limit_except_level = CRITICAL {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] rate_limit_interval = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] reinit_driver_count = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] replication_device = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] report_discard_supported = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] report_interval = 120 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] reservation_clean_interval = 86400 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] reservation_expire = 86400 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] reserved_image_namespaces = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] reserved_percentage = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] rpc_response_timeout = 120 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] run_external_periodic_tasks = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] scst_target_driver = iscsi {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] scst_target_iqn_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_down_time = 720 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] shell_completion = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] snapshot_name_template = snapshot-%s {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] snapshot_same_host = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] split_loggers = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] state_path = /opt/stack/data/cinder {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] storage_availability_zone = nova {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] storage_protocol = iSCSI {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] syslog_log_facility = LOG_USER {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] target_helper = lioadm {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] target_ip_address = 192.168.122.4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] target_port = 3260 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] target_protocol = iscsi {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] target_secondary_ip_addresses = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] trace_flags = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] transport_url = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] until_refresh = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] use_chap_auth = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] use_default_quota_class = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] use_journal = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] use_json = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] use_multipath_for_image_xfer = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] use_stderr = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] use_syslog = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] verify_glance_signatures = enabled {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_api_class = cinder.volume.api.API {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_backend_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_clear = zero {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_clear_ionice = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_clear_size = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_copy_bps_limit = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_dd_blocksize = 1M {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_name_template = volume-%s {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_service_inithost_offload = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volume_usage_audit_period = month {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] zoning_mode = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_concurrency.disable_process_locking = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.auth_section = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.auth_type = password {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.auth_version = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.cache = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.include_service_catalog = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.insecure = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.interface = public {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_password = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.068s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:17 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcache_username = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.region_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.service_type = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.4/identity {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.backend = dogpile.cache.null {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.backend_argument = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.backend_expiration_time = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.config_prefix = cache.oslo {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.debug_cache_backend = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.enable_retry_client = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.enable_socket_keepalive = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.expiration_time = 600 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.hashclient_retry_attempts = 2 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.memcache_dead_retry = 300 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.memcache_pool_maxsize = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.memcache_sasl_enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.password = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.proxies = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.redis_db = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.redis_server = localhost:6379 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.retry_attempts = 2 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.retry_delay = 0.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.socket_keepalive_count = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.socket_keepalive_idle = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.socket_keepalive_interval = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.socket_timeout = 1.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.tls_allowed_ciphers = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.tls_cafile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.tls_certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.030s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:17 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.tls_enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.tls_keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cache.username = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] coordination.backend_url = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.asyncio_connection = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.asyncio_slave_connection = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.backend = sqlalchemy {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.connection = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.connection_debug = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.connection_parameters = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.connection_recycle_time = 3600 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.connection_trace = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.db_inc_retry_interval = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.db_max_retries = 20 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.db_max_retry_interval = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.db_retry_interval = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.max_overflow = 50 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.max_pool_size = 5 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.max_retries = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.mysql_wsrep_sync_wait = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.pool_timeout = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.retry_interval = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.slave_connection = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.sqlite_synchronous = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.synchronous_reader = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] database.use_db_reconnect = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.connection_string = messaging:// {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.es_doc_type = notification {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.es_scroll_size = 10000 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.es_scroll_time = 2m {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.filter_error_trace = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.hmac_keys = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.sentinel_service_name = mymaster {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.socket_timeout = 0.1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.trace_requests = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler.trace_sqlalchemy = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler_jaeger.process_tags = {} {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler_jaeger.service_name_prefix = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] profiler_otlp.service_name_prefix = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.enforce_new_defaults = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.enforce_scope = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.policy_default_rule = default {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.policy_file = policy.yaml {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] privsep_osbrick.group = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] privsep_osbrick.helper_command = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] privsep_osbrick.user = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.032s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:17 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_sys_admin.group = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_sys_admin.helper_command = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] cinder_sys_admin.user = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.auth_section = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.auth_type = password {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.cafile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.collect_timing = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.insecure = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.send_service_user_token = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.split_loggers = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] service_user.timeout = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.auth_section = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.auth_type = password {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.collect_timing = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.insecure = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.region_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.split_loggers = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] glance.timeout = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.backend_availability_zone = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.chap_password = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.chap_username = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.disk_geometry = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.driver_client_cert = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.driver_client_cert_key = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.driver_data_namespace = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.driver_use_ssl = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.extra_capabilities = {} {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.filter_function = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.goodness_function = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.iscsi_target_flags = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.iscsi_write_cache = on {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.iser_helper = tgtadm {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.iser_ip_address = 192.168.122.4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.iser_port = 3260 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.lvm_share_target = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.lvm_type = auto {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack sudo[76164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack sudo[76164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.num_shell_tries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.replication_device = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.report_discard_supported = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.reserved_percentage = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.target_helper = tgtadm {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.target_ip_address = 192.168.122.4 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.target_port = 3260 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.target_protocol = iscsi {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.trace_flags = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.unique_fqdn_network = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.use_chap_auth = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_backend_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_clear = zero {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_clear_ionice = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_clear_size = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_reports.file_event_handler = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_reports.log_dir = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.backend_host = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.chap_password = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.chap_username = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.disk_geometry = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.driver_client_cert = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.extra_capabilities = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.filter_function = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.goodness_function = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.iser_helper = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.iser_ip_address = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.iser_port = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.lvm_share_target = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.lvm_type = auto {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.num_shell_tries = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.replication_device = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.report_discard_supported = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.reserved_percentage = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.scst_target_driver = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.storage_protocol = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.target_helper = lioadm {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.target_ip_address = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.target_port = 3260 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.trace_flags = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.use_chap_auth = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_clear = zero {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_clear_size = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] lvmdriver-1.volumes_dir = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.ssl = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_notifications.driver = [] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_notifications.retry = -1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] key_manager.fixed_key = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.barbican_api_version = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.barbican_endpoint = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.barbican_endpoint_type = public {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.barbican_region_name = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.cafile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.collect_timing = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.insecure = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.number_of_retries = 60 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.retry_delay = 1 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.send_service_user_token = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.split_loggers = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.timeout = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.verify_ssl = True {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican.verify_ssl_path = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.auth_section = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.auth_type = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.cafile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.certfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.collect_timing = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.insecure = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.keyfile = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.split_loggers = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] barbican_service_user.timeout = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.approle_role_id = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.approle_secret_id = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.kv_mountpoint = secret {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.kv_path = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.kv_version = 2 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.namespace = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.root_token_id = **** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.ssl_ca_crt_file = None {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.timeout = 60.0 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.use_ssl = False {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 20:58:17 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] ******************************************************************************** {{(pid=75991) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 20:58:18 devstack sudo[76164]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:18 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.702s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:18 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:18 devstack sudo[76271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:18 devstack sudo[76271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:18 devstack sudo[76271]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:18 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.685s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:18 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 20:58:18 devstack cinder-volume[76158]: INFO cinder.brick.local_dev.lvm [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Jul 06 20:58:18 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:18 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:18 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:18 devstack sudo[76544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:58:18 devstack sudo[76544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:19 devstack sudo[76544]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:19 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.687s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:19 devstack cinder-volume[76158]: DEBUG cinder.brick.local_dev.lvm [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76158) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:550}} Jul 06 20:58:19 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:19 devstack sudo[76729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:19 devstack sudo[76729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:20 devstack sudo[76729]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:20 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.085s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:20 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:20 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:20 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:20 devstack sudo[76922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:20 devstack sudo[76922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:21 devstack sudo[76922]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:21 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.716s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:21 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:21 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:21 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:21 devstack sudo[76940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Jul 06 20:58:21 devstack sudo[76940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:22 devstack sudo[76940]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:22 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.675s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:22 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:22 devstack sudo[76945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:58:22 devstack sudo[76945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:22 devstack sudo[76945]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:22 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.714s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:22 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:22 devstack sudo[76948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:58:22 devstack sudo[76948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:23 devstack sudo[76948]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:23 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.802s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:23 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:23 devstack sudo[76960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:58:23 devstack sudo[76960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:24 devstack sudo[76960]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:24 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.902s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:24 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:24 devstack sudo[76966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:24 devstack sudo[76966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:25 devstack sudo[76966]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:25 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.794s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:25 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:25 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.015s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:25 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:25 devstack sudo[76975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:25 devstack sudo[76975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:26 devstack sudo[76975]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:26 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.657s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:26 devstack cinder-volume[76158]: INFO cinder.volume.drivers.lvm [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Enabling LVM thin provisioning by default because a thin pool exists. Jul 06 20:58:26 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:26 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.036s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:26 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:26 devstack sudo[76985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:26 devstack sudo[76985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:26 devstack sudo[76985]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:26 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.801s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:26 devstack cinder-volume[76158]: DEBUG cinder.volume.drivers.lvm [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Updating volume stats {{(pid=76158) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:58:26 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:26 devstack sudo[77101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:58:26 devstack sudo[77101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:27 devstack cinder-volume[75991]: DEBUG dbcounter [-] [75991] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75991) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:58:27 devstack sudo[77101]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:27 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.649s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:27 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:27 devstack sudo[77107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:58:27 devstack sudo[77107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:28 devstack sudo[77107]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:28 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:28 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:28 devstack sudo[77110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:28 devstack sudo[77110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:28 devstack sudo[77110]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:28 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.646s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:28 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:28 devstack sudo[77113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:58:28 devstack sudo[77113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:29 devstack sudo[77113]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:29 devstack cinder-volume[76158]: INFO cinder.volume.driver [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Driver hasn't implemented _init_vendor_properties() Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG cinder.volume.driver [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76158) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG oslo_db.sqlalchemy.engines [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76158) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG dbcounter [-] [76158] Writer thread running {{(pid=76158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG cinder.db.api [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Building query based on filter {{(pid=76158) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG cinder.image.image_utils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76158) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 20:58:29 devstack cinder-volume[76158]: INFO cinder.keymgr.migration [None req-6fbc399e-a2f6-430b-8e3d-6870d1cb6226 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG cinder.volume.drivers.lvm [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Updating volume stats {{(pid=76158) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:58:29 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:29 devstack sudo[77117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:58:29 devstack sudo[77117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:30 devstack sudo[77117]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:30 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.643s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:30 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:30 devstack sudo[77123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:58:30 devstack sudo[77123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:30 devstack sudo[77123]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:30 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.713s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:30 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:30 devstack sudo[77128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:30 devstack sudo[77128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:31 devstack sudo[77128]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:31 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.647s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:31 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:31 devstack sudo[77131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:58:31 devstack sudo[77131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:32 devstack sudo[77131]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:32 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.635s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:32 devstack cinder-volume[76158]: DEBUG cinder.manager [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Notifying Schedulers of capabilities ... {{(pid=76158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 20:58:32 devstack cinder-volume[76158]: INFO cinder.volume.manager [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Driver initialization completed successfully. Jul 06 20:58:32 devstack cinder-volume[76158]: INFO cinder.manager [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Initiating service 2 cleanup Jul 06 20:58:32 devstack cinder-volume[76158]: INFO cinder.manager [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Service 2 cleanup completed. Jul 06 20:58:32 devstack cinder-volume[76158]: DEBUG cinder.service [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Creating RPC server for service cinder-volume {{(pid=76158) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 20:58:32 devstack cinder-volume[76158]: DEBUG cinder.service [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76158) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 20:58:32 devstack cinder-volume[76158]: INFO cinder.volume.manager [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Jul 06 20:58:32 devstack cinder-volume[76158]: DEBUG cinder.volume.drivers.lvm [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Updating volume stats {{(pid=76158) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 20:58:32 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:32 devstack sudo[77134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 20:58:32 devstack sudo[77134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:33 devstack sudo[77134]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:33 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.638s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:33 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:33 devstack sudo[77137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:58:33 devstack sudo[77137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:33 devstack sudo[77137]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:33 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.665s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:33 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:33 devstack sudo[77143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 20:58:33 devstack sudo[77143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:34 devstack sudo[77143]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:34 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.614s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:34 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 20:58:34 devstack sudo[77146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 20:58:34 devstack sudo[77146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 20:58:34 devstack sudo[77146]: pam_unix(sudo:session): session closed for user root Jul 06 20:58:34 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.662s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 20:58:34 devstack cinder-volume[76158]: INFO cinder.volume.manager [None req-2af2af94-3f39-44f1-b1c3-acfed790050d None None] Driver post RPC initialization completed successfully. Jul 06 20:58:44 devstack cinder-volume[76158]: DEBUG dbcounter [-] [76158] Writing DB stats cinder:SELECT=3 {{(pid=76158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:58:45 devstack cinder-volume[76158]: DEBUG dbcounter [-] [76158] Writing DB stats cinder:SELECT=11,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 20:59:12 devstack cinder-volume[76158]: DEBUG oslo_service.periodic_task [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running periodic task VolumeManager._thread_info {{(pid=76158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 20:59:12 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread count: 6 {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 20:59:12 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread info: [<_MainThread(MainThread, started 138616892891264)>, , , , , ] {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:00:12 devstack cinder-volume[76158]: DEBUG oslo_service.periodic_task [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:00:12 devstack cinder-volume[76158]: DEBUG cinder.volume.drivers.lvm [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Updating volume stats {{(pid=76158) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 21:00:12 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:13 devstack sudo[79710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 21:00:13 devstack sudo[79710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:13 devstack sudo[79710]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:13 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.620s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:13 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:13 devstack sudo[79713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 21:00:13 devstack sudo[79713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:14 devstack sudo[79713]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.616s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:14 devstack sudo[79716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 21:00:14 devstack sudo[79716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:14 devstack sudo[79716]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.618s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:00:14 devstack sudo[79719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 21:00:14 devstack sudo[79719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:00:15 devstack sudo[79719]: pam_unix(sudo:session): session closed for user root Jul 06 21:00:15 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:00:15 devstack cinder-volume[76158]: DEBUG cinder.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Notifying Schedulers of capabilities ... {{(pid=76158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:00:15 devstack cinder-volume[76158]: DEBUG oslo_service.periodic_task [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running periodic task VolumeManager._thread_info {{(pid=76158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:00:15 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread count: 6 {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:00:15 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread info: [<_MainThread(MainThread, started 138616892891264)>, , , , , ] {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:00:45 devstack cinder-volume[76158]: DEBUG dbcounter [-] [76158] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=76158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:01:12 devstack cinder-volume[76158]: DEBUG oslo_service.periodic_task [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:01:12 devstack cinder-volume[76158]: DEBUG cinder.volume.drivers.lvm [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Updating volume stats {{(pid=76158) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 21:01:12 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:13 devstack sudo[83328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 21:01:13 devstack sudo[83328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:13 devstack sudo[83328]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:13 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.664s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:13 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:13 devstack sudo[83390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 21:01:13 devstack sudo[83390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:14 devstack sudo[83390]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.625s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:14 devstack sudo[83430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 21:01:14 devstack sudo[83430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:14 devstack sudo[83430]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.634s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:01:14 devstack sudo[83445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 21:01:14 devstack sudo[83445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:01:15 devstack sudo[83445]: pam_unix(sudo:session): session closed for user root Jul 06 21:01:15 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.608s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:01:15 devstack cinder-volume[76158]: DEBUG cinder.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Notifying Schedulers of capabilities ... {{(pid=76158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:01:15 devstack cinder-volume[76158]: DEBUG oslo_service.periodic_task [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running periodic task VolumeManager._thread_info {{(pid=76158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:01:15 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread count: 6 {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:01:15 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread info: [<_MainThread(MainThread, started 138616892891264)>, , , , , ] {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:02:12 devstack cinder-volume[76158]: DEBUG oslo_service.periodic_task [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:02:12 devstack cinder-volume[76158]: DEBUG cinder.volume.drivers.lvm [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Updating volume stats {{(pid=76158) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:228}} Jul 06 21:02:12 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:13 devstack sudo[84941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Jul 06 21:02:13 devstack sudo[84941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:13 devstack sudo[84941]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:13 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.658s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:13 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:13 devstack sudo[84980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 21:02:13 devstack sudo[84980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:14 devstack sudo[84980]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.694s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:14 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:14 devstack sudo[84995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Jul 06 21:02:14 devstack sudo[84995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:15 devstack sudo[84995]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:15 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.664s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:15 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:02:15 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Jul 06 21:02:15 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:02:15 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Jul 06 21:02:15 devstack cinder-volume[76158]: DEBUG oslo_concurrency.processutils [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.675s {{(pid=76158) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:02:15 devstack cinder-volume[76158]: DEBUG cinder.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Notifying Schedulers of capabilities ... {{(pid=76158) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:02:15 devstack cinder-volume[76158]: DEBUG oslo_service.periodic_task [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] Running periodic task VolumeManager._thread_info {{(pid=76158) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:02:15 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread count: 6 {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:02:15 devstack cinder-volume[76158]: DEBUG cinder.volume.manager [None req-764a6fa2-7222-4dc7-9b82-944d73ff1b9c None None] thread info: [<_MainThread(MainThread, started 138616892891264)>, , , , , ] {{(pid=76158) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:02:45 devstack cinder-volume[76158]: DEBUG dbcounter [-] [76158] Writing DB stats cinder:SELECT=1 {{(pid=76158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:02:45 devstack cinder-volume[76158]: DEBUG dbcounter [-] [76158] Writing DB stats cinder:UPDATE=1 {{(pid=76158) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:07 devstack cinder-volume[75991]: INFO oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Caught SIGTERM, stopping children Jul 06 21:03:07 devstack cinder-volume[75991]: DEBUG oslo_concurrency.lockutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Acquiring lock "singleton_lock" {{(pid=75991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 21:03:07 devstack cinder-volume[75991]: DEBUG oslo_concurrency.lockutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Acquired lock "singleton_lock" {{(pid=75991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 21:03:07 devstack cinder-volume[75991]: DEBUG oslo_concurrency.lockutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Releasing lock "singleton_lock" {{(pid=75991) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 21:03:07 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Stop services. {{(pid=75991) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 21:03:07 devstack cinder-volume[75991]: DEBUG oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Killing children. {{(pid=75991) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 21:03:07 devstack cinder-volume[75991]: INFO oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Waiting on 1 children to exit Jul 06 21:03:12 devstack cinder-volume[76158]: DEBUG oslo_concurrency.lockutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Acquiring lock "singleton_lock" {{(pid=76158) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 21:03:12 devstack cinder-volume[76158]: DEBUG oslo_concurrency.lockutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Acquired lock "singleton_lock" {{(pid=76158) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 21:03:12 devstack cinder-volume[76158]: DEBUG oslo_concurrency.lockutils [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Releasing lock "singleton_lock" {{(pid=76158) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 21:03:12 devstack cinder-volume[76158]: WARNING amqp [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 21:03:12 devstack cinder-volume[76158]: WARNING amqp [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 21:03:12 devstack cinder-volume[75991]: INFO oslo_service.backend._eventlet.service [None req-3660798a-b97e-4e26-bcac-a63e7e711d37 None None] Child 76158 exited with status 0 Jul 06 21:03:12 devstack cinder-volume[86417]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 21:03:12 devstack cinder-volume[86417]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 21:03:12 devstack cinder-volume[86417]: we strongly recommend against using it for new projects. Jul 06 21:03:12 devstack cinder-volume[86417]: If you are already using Eventlet, we recommend migrating to a different Jul 06 21:03:12 devstack cinder-volume[86417]: framework. For more detail see Jul 06 21:03:12 devstack cinder-volume[86417]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 21:03:12 devstack cinder-volume[86417]: import eventlet # noqa Jul 06 21:03:14 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 21:03:14 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 21:03:14 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 21:03:15 devstack cinder-volume[86417]: INFO dbcounter [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Registered counter for database cinder Jul 06 21:03:15 devstack cinder-volume[86417]: DEBUG oslo_db.sqlalchemy.engines [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG dbcounter [-] [86417] Writer thread running {{(pid=86417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 21:03:16 devstack cinder-volume[86417]: INFO cinder.rpc [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 21:03:16 devstack cinder-volume[86417]: INFO cinder.rpc [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_db.sqlalchemy.engines [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:16 devstack cinder-volume[86417]: INFO cinder.volume.manager [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Determined volume DB was empty at startup. Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG cinder.volume.manager [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86417) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 21:03:16 devstack cinder-volume[86417]: INFO cinder.volume.manager [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Service not found for updating active_backend_id, assuming default for driver init. Jul 06 21:03:16 devstack cinder-volume[86417]: WARNING stevedore.named [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 21:03:16 devstack cinder-volume[86417]: WARNING castellan.key_manager [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 21:03:16 devstack cinder-volume[86417]: WARNING cinder.keymgr.conf_key_mgr [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 21:03:16 devstack cinder-volume[86417]: INFO cinder.volume.manager [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_db.sqlalchemy.engines [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86417) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:16 devstack cinder-volume[86417]: INFO oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Starting 1 workers Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Started child 86695 {{(pid=86417) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Full set of CONF: {{(pid=86417) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] ******************************************************************************** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Configuration options gathered from: {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] ================================================================================ {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 21:03:16 devstack cinder-volume[86695]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] allow_availability_zone_fallback = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] allow_compression_on_image_upload = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] allowed_direct_url_schemes = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] api_rate_limit = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] auth_strategy = keystone {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_availability_zone = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_host = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_stats_polling_interval = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backup_api_class = cinder.backup.api.API {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backup_name_template = backup-%s {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backup_use_same_host = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backup_use_temp_snapshot = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] chap_password = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] chap_username = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_internal_tenant_project_id = 8a35397beacb4cf3b92d396602117f44 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_internal_tenant_user_id = 3c6bf7171305436f9c99ea0dae90024e {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cluster = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] compression_format = gzip {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] compute_api_class = cinder.compute.nova.API {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] config_dir = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] config_source = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] control_exchange = openstack {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] debug = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] default_availability_zone = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] default_group_type = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] default_volume_type = QuobyteHD {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] disk_geometry = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] driver_client_cert = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] driver_client_cert_key = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] driver_data_namespace = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] driver_ssl_cert_path = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] driver_ssl_cert_verify = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] driver_use_ssl = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] enable_new_services = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] enable_unsupported_driver = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] enabled_backends = ['QuobyteHD'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] enforce_multipath_for_image_xfer = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] filter_function = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_api_insecure = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_api_servers = ['http://192.168.122.4/image'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_api_ssl_compression = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_ca_certificates_file = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_catalog_info = image:glance:publicURL {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_num_retries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance_request_timeout = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] goodness_function = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] graceful_shutdown_timeout = 5 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] group_api_class = cinder.group.api.API {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] host = devstack {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_compress_on_upload = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_conversion_address_space_limit = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_conversion_cpu_limit = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_conversion_disable = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_upload_use_cinder_backend = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_upload_use_internal_tenant = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_volume_cache_enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_volume_cache_max_count = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] image_volume_cache_max_size_gb = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] init_host_max_objects_retrieval = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] instance_format = [instance: %(uuid)s] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] iscsi_target_flags = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] iscsi_write_cache = on {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] iser_helper = tgtadm {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] iser_ip_address = 192.168.122.4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] iser_port = 3260 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_color = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_config_append = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_dir = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_file = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_options = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_rotate_interval = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.remotefs [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86695) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_rotate_interval_type = days {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] log_rotation_type = none {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] max_age = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] max_logfile_count = 30 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] max_logfile_size_mb = 200 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] max_over_subscription_ratio = 20.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] message_reap_interval = 86400 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] message_ttl = 2592000 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] migration_create_volume_timeout_secs = 300 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] monkey_patch = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] monkey_patch_modules = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] my_ip = 192.168.122.4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] no_snapshot_gb_quota = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] num_iser_scan_tries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] num_shell_tries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] num_volume_device_scan_tries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] nvmeof_conn_info_version = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] nvmet_ns_id = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] nvmet_port_id = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] osapi_max_limit = 1000 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] osapi_volume_ext_list = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] osapi_volume_listen_port = 8776 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] osapi_volume_use_ssl = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] osapi_volume_workers = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] per_volume_size_limit = -1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] periodic_fuzzy_delay = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] periodic_interval = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] public_endpoint = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] publish_errors = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] quota_backup_gigabytes = 1000 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] quota_backups = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] quota_gigabytes = 1000 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] quota_groups = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] quota_snapshots = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] quota_volumes = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] rate_limit_burst = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] rate_limit_except_level = CRITICAL {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] rate_limit_interval = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] reinit_driver_count = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] replication_device = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] report_discard_supported = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] report_interval = 120 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] reservation_clean_interval = 86400 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] reservation_expire = 86400 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] reserved_image_namespaces = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] reserved_percentage = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] rpc_response_timeout = 120 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] run_external_periodic_tasks = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] scst_target_driver = iscsi {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] scst_target_iqn_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_down_time = 720 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] shell_completion = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] snapshot_name_template = snapshot-%s {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] split_loggers = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] state_path = /opt/stack/data/cinder {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] storage_availability_zone = nova {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] storage_protocol = iSCSI {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] syslog_log_facility = LOG_USER {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] target_helper = lioadm {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] target_ip_address = 192.168.122.4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] target_port = 3260 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] target_protocol = iscsi {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] target_secondary_ip_addresses = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] trace_flags = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] transport_url = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] until_refresh = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] use_chap_auth = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] use_default_quota_class = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] use_journal = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] use_json = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] use_multipath_for_image_xfer = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] use_stderr = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] use_syslog = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] verify_glance_signatures = enabled {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_api_class = cinder.volume.api.API {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_backend_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_clear = zero {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_clear_ionice = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_clear_size = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_copy_bps_limit = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_dd_blocksize = 1M {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_name_template = volume-%s {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_service_inithost_offload = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volume_usage_audit_period = month {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] zoning_mode = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_concurrency.disable_process_locking = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.auth_section = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.auth_type = password {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.auth_version = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.cache = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.include_service_catalog = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.insecure = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.interface = public {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_password = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcache_username = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.region_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.service_type = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.4/identity {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.backend = dogpile.cache.null {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.backend_argument = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.backend_expiration_time = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.config_prefix = cache.oslo {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.debug_cache_backend = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.enable_retry_client = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.enable_socket_keepalive = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.expiration_time = 600 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.hashclient_retry_attempts = 2 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.memcache_dead_retry = 300 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.memcache_pool_maxsize = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.memcache_sasl_enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86695) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 21:03:16 devstack cinder-volume[86695]: WARNING cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.password = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: WARNING cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.proxies = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.redis_db = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Running cmd (subprocess): mount.quobyte {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.redis_server = localhost:6379 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.retry_attempts = 2 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.retry_delay = 0.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.socket_keepalive_count = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.socket_keepalive_idle = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.socket_keepalive_interval = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.socket_timeout = 1.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.tls_allowed_ciphers = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.tls_cafile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.tls_certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.tls_enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.tls_keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cache.username = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] coordination.backend_url = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.asyncio_connection = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.asyncio_slave_connection = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.backend = sqlalchemy {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.connection = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.connection_debug = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.connection_parameters = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.connection_recycle_time = 3600 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.connection_trace = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.db_inc_retry_interval = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.db_max_retries = 20 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.db_max_retry_interval = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.db_retry_interval = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.max_overflow = 50 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.max_pool_size = 5 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.max_retries = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.mysql_wsrep_sync_wait = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.pool_timeout = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.retry_interval = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.slave_connection = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.sqlite_synchronous = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.synchronous_reader = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] database.use_db_reconnect = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.connection_string = messaging:// {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.es_doc_type = notification {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.es_scroll_size = 10000 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.es_scroll_time = 2m {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.filter_error_trace = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.hmac_keys = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.sentinel_service_name = mymaster {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.socket_timeout = 0.1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.trace_requests = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler.trace_sqlalchemy = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler_jaeger.process_tags = {} {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler_jaeger.service_name_prefix = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] profiler_otlp.service_name_prefix = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.enforce_new_defaults = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.enforce_scope = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.policy_default_rule = default {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.policy_file = policy.yaml {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] privsep_osbrick.group = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] privsep_osbrick.helper_command = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] privsep_osbrick.user = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_sys_admin.group = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_sys_admin.helper_command = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] cinder_sys_admin.user = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.auth_section = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.auth_type = password {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.cafile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.collect_timing = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.insecure = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.send_service_user_token = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.split_loggers = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] service_user.timeout = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.auth_section = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.auth_type = password {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.collect_timing = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.insecure = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.region_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.split_loggers = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] glance.timeout = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.backend_availability_zone = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.chap_password = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.chap_username = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.disk_geometry = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.driver_client_cert = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.driver_client_cert_key = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.driver_data_namespace = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.driver_use_ssl = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.extra_capabilities = {} {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.filter_function = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.goodness_function = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.iscsi_target_flags = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.iscsi_write_cache = on {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.iser_helper = tgtadm {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.iser_ip_address = 192.168.122.4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.iser_port = 3260 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_host = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_login = admin {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_mount_options = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_password = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_private_key = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_share_path = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.num_shell_tries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.quobyte_volume_url = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.replication_device = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.report_discard_supported = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.reserved_percentage = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.target_helper = tgtadm {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.target_ip_address = 192.168.122.4 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.target_port = 3260 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.target_protocol = iscsi {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.trace_flags = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.unique_fqdn_network = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.use_chap_auth = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_backend_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_clear = zero {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_clear_ionice = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_clear_size = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_reports.file_event_handler = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_reports.log_dir = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.backend_availability_zone = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.backend_host = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.chap_password = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.chap_username = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.chiscsi_conf = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.disk_geometry = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.driver_client_cert = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.driver_data_namespace = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.driver_use_ssl = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.extra_capabilities = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.filter_function = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.goodness_function = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.iser_helper = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.iser_ip_address = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.iser_port = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.iser_target_prefix = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_host = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_login = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_mount_options = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_password = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_private_key = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_share_path = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_ssh_port = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.num_shell_tries = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.nvmet_port_id = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.replication_device = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.report_discard_supported = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.reserved_percentage = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.scst_target_driver = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.storage_protocol = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.target_helper = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.target_ip_address = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.target_port = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.target_prefix = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.target_protocol = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.trace_flags = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.use_chap_auth = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_clear = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_clear_size = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] QuobyteHD.volumes_dir = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack quobyte-client[86700]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack quobyte-client[86700]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.ssl = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_notifications.driver = [] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_notifications.retry = -1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] key_manager.fixed_key = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.barbican_api_version = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.barbican_endpoint = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.barbican_endpoint_type = public {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.barbican_region_name = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.cafile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] CMD "mount.quobyte" returned: 1 in 0.145s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.collect_timing = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.insecure = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.number_of_retries = 60 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.retry_delay = 1 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.send_service_user_token = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.split_loggers = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.timeout = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.verify_ssl = True {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican.verify_ssl_path = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=86695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.auth_section = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.auth_type = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.cafile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.certfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.collect_timing = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.insecure = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: INFO cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f ... Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.keyfile = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.split_loggers = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 -c /etc/quobyte/client-cinder.cfg {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] barbican_service_user.timeout = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.approle_role_id = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.approle_secret_id = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.kv_mountpoint = secret {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.kv_path = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.kv_version = 2 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.namespace = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.root_token_id = **** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.ssl_ca_crt_file = None {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.timeout = 60.0 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.use_ssl = False {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:16 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] ******************************************************************************** {{(pid=86417) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 21:03:16 devstack sudo[86709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 -c /etc/quobyte/client-cinder.cfg Jul 06 21:03:16 devstack sudo[86709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:17 devstack sudo[86709]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:17 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.776s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:17 devstack cinder-volume[86695]: INFO cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f succeeded Jul 06 21:03:17 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=86695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:17 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.795s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:17 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:17 devstack sudo[86781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:03:17 devstack sudo[86781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:18 devstack sudo[86781]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.612s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:18 devstack cinder-volume[86695]: INFO cinder.volume.driver [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Driver hasn't implemented _init_vendor_properties() Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG cinder.volume.driver [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6398010253906, 'free_capacity_gb': 1775.6398010253906, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86695) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG oslo_db.sqlalchemy.engines [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86695) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG dbcounter [-] [86695] Writer thread running {{(pid=86695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG cinder.db.api [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Building query based on filter {{(pid=86695) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG cinder.image.image_utils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86695) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 21:03:18 devstack cinder-volume[86695]: INFO cinder.keymgr.migration [None req-3442317d-9e36-41e1-96bc-9141f96c9e69 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=86695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=86695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:18 devstack sudo[86786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:03:18 devstack sudo[86786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:18 devstack sudo[86786]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.642s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:18 devstack cinder-volume[86695]: DEBUG cinder.manager [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Notifying Schedulers of capabilities ... {{(pid=86695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:03:19 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Driver initialization completed successfully. Jul 06 21:03:19 devstack cinder-volume[86695]: INFO cinder.manager [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Initiating service 3 cleanup Jul 06 21:03:19 devstack cinder-volume[86695]: INFO cinder.manager [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Service 3 cleanup completed. Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG cinder.service [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Creating RPC server for service cinder-volume {{(pid=86695) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG cinder.service [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86695) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 21:03:19 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=86695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=86695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:19 devstack sudo[86794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:03:19 devstack sudo[86794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:19 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.651s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:19 devstack sudo[86794]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:19 devstack cinder-volume[86695]: INFO cinder.volume.manager [None req-a8d43906-f2a6-43da-aca0-026a8d9c93af None None] Driver post RPC initialization completed successfully. Jul 06 21:03:23 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:23 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:23 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=86695) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:23 devstack cinder-volume[86695]: DEBUG cinder.volume.drivers.quobyte [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=86695) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:23 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86695) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:23 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:23 devstack sudo[86907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:03:23 devstack sudo[86907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:24 devstack sudo[86907]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:24 devstack cinder-volume[86695]: DEBUG oslo_concurrency.processutils [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.640s {{(pid=86695) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:24 devstack cinder-volume[86695]: DEBUG cinder.manager [None req-6ac682c5-b988-443f-bedf-2fabbb27ae61 None None] Notifying Schedulers of capabilities ... {{(pid=86695) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:03:26 devstack cinder-volume[86417]: DEBUG dbcounter [-] [86417] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86417) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:27 devstack cinder-volume[86417]: INFO oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Caught SIGTERM, stopping children Jul 06 21:03:27 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Acquiring lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 21:03:27 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Acquired lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 21:03:27 devstack cinder-volume[86417]: DEBUG oslo_concurrency.lockutils [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Releasing lock "singleton_lock" {{(pid=86417) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 21:03:27 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Stop services. {{(pid=86417) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Jul 06 21:03:27 devstack cinder-volume[86417]: DEBUG oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Killing children. {{(pid=86417) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Jul 06 21:03:27 devstack cinder-volume[86417]: INFO oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Waiting on 1 children to exit Jul 06 21:03:29 devstack cinder-volume[86695]: DEBUG dbcounter [-] [86695] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=86695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:29 devstack cinder-volume[86695]: DEBUG dbcounter [-] [86695] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=86695) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:32 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Acquiring lock "singleton_lock" {{(pid=86695) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 21:03:32 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Acquired lock "singleton_lock" {{(pid=86695) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 21:03:32 devstack cinder-volume[86695]: DEBUG oslo_concurrency.lockutils [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Releasing lock "singleton_lock" {{(pid=86695) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 21:03:32 devstack cinder-volume[86695]: WARNING amqp [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 21:03:32 devstack cinder-volume[86695]: WARNING amqp [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Received method (60, 30) during closing channel 1. This method will be ignored Jul 06 21:03:32 devstack cinder-volume[86417]: INFO oslo_service.backend._eventlet.service [None req-e2e0bfd6-6da1-44d9-8533-c06acb847e06 None None] Child 86695 exited with status 0 Jul 06 21:03:32 devstack cinder-volume[86997]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Jul 06 21:03:32 devstack cinder-volume[86997]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 21:03:32 devstack cinder-volume[86997]: we strongly recommend against using it for new projects. Jul 06 21:03:32 devstack cinder-volume[86997]: If you are already using Eventlet, we recommend migrating to a different Jul 06 21:03:32 devstack cinder-volume[86997]: framework. For more detail see Jul 06 21:03:32 devstack cinder-volume[86997]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 21:03:32 devstack cinder-volume[86997]: import eventlet # noqa Jul 06 21:03:35 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:395}} Jul 06 21:03:35 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:398}} Jul 06 21:03:35 devstack cinder-volume[86997]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86997) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:418}} Jul 06 21:03:36 devstack cinder-volume[86997]: INFO dbcounter [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Registered counter for database cinder Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_db.sqlalchemy.engines [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG dbcounter [-] [86997] Writer thread running {{(pid=86997) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 21:03:36 devstack cinder-volume[86997]: INFO cinder.rpc [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Jul 06 21:03:36 devstack cinder-volume[86997]: INFO cinder.rpc [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_db.sqlalchemy.engines [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:36 devstack cinder-volume[86997]: INFO cinder.volume.manager [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Determined volume DB was empty at startup. Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG cinder.volume.manager [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86997) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Jul 06 21:03:36 devstack cinder-volume[86997]: WARNING stevedore.named [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Jul 06 21:03:36 devstack cinder-volume[86997]: WARNING castellan.key_manager [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 21:03:36 devstack cinder-volume[86997]: WARNING cinder.keymgr.conf_key_mgr [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Jul 06 21:03:36 devstack cinder-volume[86997]: INFO cinder.volume.manager [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Image-volume cache disabled for host devstack@QuobyteHD. Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_db.sqlalchemy.engines [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86997) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:36 devstack cinder-volume[86997]: INFO oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Starting 1 workers Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Started child 87273 {{(pid=86997) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Full set of CONF: {{(pid=86997) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] ******************************************************************************** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3226}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] Configuration options gathered from: {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3227}} Jul 06 21:03:36 devstack cinder-volume[87273]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3228}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3229}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] ================================================================================ {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3234}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] allow_availability_zone_fallback = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] allow_compression_on_image_upload = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] allowed_direct_url_schemes = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] api_rate_limit = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] auth_strategy = keystone {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_availability_zone = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_host = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_stats_polling_interval = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backup_api_class = cinder.backup.api.API {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backup_name_template = backup-%s {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backup_use_same_host = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backup_use_temp_snapshot = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] chap_password = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] chap_username = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_internal_tenant_project_id = 8a35397beacb4cf3b92d396602117f44 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_internal_tenant_user_id = 3c6bf7171305436f9c99ea0dae90024e {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cluster = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] compression_format = gzip {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] compute_api_class = cinder.compute.nova.API {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] config_dir = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] config_source = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] control_exchange = openstack {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] debug = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] default_availability_zone = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] default_group_type = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] default_volume_type = QuobyteHD {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] disk_geometry = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] driver_client_cert = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] driver_client_cert_key = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] driver_data_namespace = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] driver_ssl_cert_path = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] driver_ssl_cert_verify = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] driver_use_ssl = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] enable_new_services = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] enable_unsupported_driver = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] enabled_backends = ['QuobyteHD'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] enforce_multipath_for_image_xfer = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] filter_function = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_api_insecure = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_api_servers = ['http://192.168.122.4/image'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_api_ssl_compression = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_ca_certificates_file = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_catalog_info = image:glance:publicURL {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_num_retries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance_request_timeout = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] goodness_function = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] graceful_shutdown_timeout = 5 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] group_api_class = cinder.group.api.API {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] host = devstack {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_compress_on_upload = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_conversion_address_space_limit = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_conversion_cpu_limit = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_conversion_disable = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_upload_use_cinder_backend = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_upload_use_internal_tenant = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_volume_cache_enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_volume_cache_max_count = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] image_volume_cache_max_size_gb = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] init_host_max_objects_retrieval = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] instance_format = [instance: %(uuid)s] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] iscsi_target_flags = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] iscsi_write_cache = on {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] iser_helper = tgtadm {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] iser_ip_address = 192.168.122.4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] iser_port = 3260 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_color = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_config_append = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_dir = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_file = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_options = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_rotate_interval = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_rotate_interval_type = days {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] log_rotation_type = none {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] max_age = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Starting volume driver QuobyteDriver (1.1.14) Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] max_logfile_count = 30 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] max_logfile_size_mb = 200 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] max_over_subscription_ratio = 20.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] message_reap_interval = 86400 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] message_ttl = 2592000 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] migration_create_volume_timeout_secs = 300 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] monkey_patch = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] monkey_patch_modules = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] my_ip = 192.168.122.4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] no_snapshot_gb_quota = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] num_iser_scan_tries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87273) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] num_shell_tries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] num_volume_device_scan_tries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] nvmeof_conn_info_version = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] nvmet_ns_id = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] nvmet_port_id = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] osapi_max_limit = 1000 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] osapi_volume_ext_list = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] osapi_volume_listen_port = 8776 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] osapi_volume_use_ssl = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] osapi_volume_workers = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] per_volume_size_limit = -1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] periodic_fuzzy_delay = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] periodic_interval = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] public_endpoint = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] publish_errors = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] quota_backup_gigabytes = 1000 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] quota_backups = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] quota_gigabytes = 1000 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] quota_groups = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] quota_snapshots = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] quota_volumes = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] rate_limit_burst = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] rate_limit_except_level = CRITICAL {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] rate_limit_interval = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] reinit_driver_count = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] replication_device = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] report_discard_supported = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] report_interval = 120 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] reservation_clean_interval = 86400 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] reservation_expire = 86400 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] reserved_image_namespaces = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] reserved_percentage = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] rpc_response_timeout = 120 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] run_external_periodic_tasks = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] scst_target_driver = iscsi {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] scst_target_iqn_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_down_time = 720 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] shell_completion = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] snapshot_name_template = snapshot-%s {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] split_loggers = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] state_path = /opt/stack/data/cinder {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] storage_availability_zone = nova {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] storage_protocol = iSCSI {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] syslog_log_facility = LOG_USER {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] target_helper = lioadm {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] target_ip_address = 192.168.122.4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] target_port = 3260 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] target_protocol = iscsi {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] target_secondary_ip_addresses = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] trace_flags = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] transport_url = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] until_refresh = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] use_chap_auth = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] use_default_quota_class = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] use_journal = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] use_json = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] use_multipath_for_image_xfer = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] use_stderr = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] use_syslog = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] verify_glance_signatures = enabled {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_api_class = cinder.volume.api.API {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_backend_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_clear = zero {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_clear_ionice = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_clear_size = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_copy_bps_limit = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_dd_blocksize = 1M {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_name_template = volume-%s {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_service_inithost_offload = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volume_usage_audit_period = month {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] zoning_mode = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3242}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_concurrency.disable_process_locking = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.auth_section = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.auth_type = password {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.auth_version = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.cache = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.include_service_catalog = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.insecure = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.interface = public {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_password = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcache_username = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.region_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.service_type = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.4/identity {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.backend = dogpile.cache.null {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.backend_argument = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.backend_expiration_time = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.config_prefix = cache.oslo {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.debug_cache_backend = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.enable_retry_client = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.enable_socket_keepalive = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.expiration_time = 600 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.hashclient_retry_attempts = 2 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.memcache_dead_retry = 300 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87273) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:305}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.memcache_pool_maxsize = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.memcache_sasl_enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.password = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.proxies = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Jul 06 21:03:36 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.redis_db = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.redis_server = localhost:6379 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.retry_attempts = 2 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Running cmd (subprocess): mount.quobyte {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.retry_delay = 0.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.socket_keepalive_count = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.socket_keepalive_idle = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.socket_keepalive_interval = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.socket_timeout = 1.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.tls_allowed_ciphers = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.tls_cafile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.tls_certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.tls_enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.tls_keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cache.username = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] coordination.backend_url = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.asyncio_connection = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.asyncio_slave_connection = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.backend = sqlalchemy {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.connection = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.connection_debug = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.connection_parameters = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.connection_recycle_time = 3600 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.connection_trace = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.db_inc_retry_interval = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.db_max_retries = 20 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.db_max_retry_interval = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.db_retry_interval = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.max_overflow = 50 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.max_pool_size = 5 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.max_retries = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.mysql_wsrep_sync_wait = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.pool_timeout = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.retry_interval = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.slave_connection = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.sqlite_synchronous = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.synchronous_reader = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] database.use_db_reconnect = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.connection_string = messaging:// {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.es_doc_type = notification {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.es_scroll_size = 10000 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.es_scroll_time = 2m {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.filter_error_trace = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.hmac_keys = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.sentinel_service_name = mymaster {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.socket_timeout = 0.1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.trace_requests = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler.trace_sqlalchemy = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler_jaeger.process_tags = {} {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler_jaeger.service_name_prefix = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] profiler_otlp.service_name_prefix = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.enforce_new_defaults = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.enforce_scope = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.policy_default_rule = default {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.policy_file = policy.yaml {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] privsep_osbrick.group = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] privsep_osbrick.helper_command = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] privsep_osbrick.user = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_sys_admin.group = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_sys_admin.helper_command = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] cinder_sys_admin.user = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.auth_section = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.auth_type = password {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.cafile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.collect_timing = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.insecure = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.send_service_user_token = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.split_loggers = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] service_user.timeout = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.auth_section = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.auth_type = password {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.collect_timing = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.insecure = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.region_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.split_loggers = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] glance.timeout = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.backend_availability_zone = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.chap_password = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.chap_username = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.disk_geometry = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.driver_client_cert = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.driver_client_cert_key = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.driver_data_namespace = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.driver_use_ssl = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.extra_capabilities = {} {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.filter_function = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.goodness_function = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.iscsi_target_flags = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.iscsi_write_cache = on {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.iser_helper = tgtadm {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.iser_ip_address = 192.168.122.4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack quobyte-client[87278]: Reading configuration file: /etc/quobyte/client.cfg Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.iser_port = 3260 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_host = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_login = admin {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_mount_options = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack quobyte-client[87278]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_password = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] CMD "mount.quobyte" returned: 1 in 0.050s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_private_key = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_share_path = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.num_shell_tries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.quobyte_volume_url = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.replication_device = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.report_discard_supported = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.reserved_percentage = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.target_helper = tgtadm {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.target_ip_address = 192.168.122.4 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.target_port = 3260 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.target_protocol = iscsi {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.trace_flags = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.unique_fqdn_network = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.use_chap_auth = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_backend_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_clear = zero {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_clear_ionice = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_clear_size = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_reports.file_event_handler = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_reports.log_dir = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.backend_availability_zone = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.backend_host = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.chap_password = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.chap_username = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.chiscsi_conf = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.disk_geometry = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.driver_client_cert = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.driver_data_namespace = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.driver_use_ssl = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.enable_unsupported_driver = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.extra_capabilities = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.filter_function = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.goodness_function = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:36 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.iser_helper = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.iser_ip_address = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.iser_port = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.iser_target_prefix = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_host = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_login = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_mount_options = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_password = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_private_key = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_share_path = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_ssh_port = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.num_shell_tries = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack sudo[87279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.nvmet_port_id = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack sudo[87279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.replication_device = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.report_discard_supported = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.reserved_percentage = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.scst_target_driver = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.storage_protocol = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.target_helper = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.target_ip_address = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.target_port = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.target_prefix = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.target_protocol = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.trace_flags = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.use_chap_auth = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_clear = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_clear_size = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] QuobyteHD.volumes_dir = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.ssl = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_notifications.driver = [] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_notifications.retry = -1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] key_manager.fixed_key = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.barbican_api_version = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.barbican_endpoint = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.barbican_endpoint_type = public {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.barbican_region_name = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.cafile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.collect_timing = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.insecure = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.number_of_retries = 60 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.retry_delay = 1 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.send_service_user_token = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.split_loggers = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.timeout = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.verify_ssl = True {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican.verify_ssl_path = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.auth_section = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.auth_type = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.cafile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.certfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.collect_timing = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.insecure = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.keyfile = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.split_loggers = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] barbican_service_user.timeout = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.approle_role_id = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.approle_secret_id = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.kv_mountpoint = secret {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.kv_path = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.kv_version = 2 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.namespace = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.root_token_id = **** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.ssl_ca_crt_file = None {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.timeout = 60.0 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.use_ssl = False {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3253}} Jul 06 21:03:37 devstack cinder-volume[86997]: DEBUG oslo_service.backend._eventlet.service [None req-7272b700-691f-4585-9fbf-3e3d20bdef10 None None] ******************************************************************************** {{(pid=86997) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3260}} Jul 06 21:03:37 devstack sudo[87279]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.629s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:37 devstack cinder-volume[87273]: INFO cinder.volume.driver [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Driver hasn't implemented _init_vendor_properties() Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG cinder.volume.driver [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6654739379883, 'free_capacity_gb': 1775.6654739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87273) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG oslo_db.sqlalchemy.engines [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87273) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writer thread running {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG cinder.db.api [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Building query based on filter {{(pid=87273) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87273) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:37 devstack cinder-volume[87273]: INFO cinder.keymgr.migration [None req-30798ef0-b598-453f-96ab-59d188cd7f26 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Jul 06 21:03:37 devstack sudo[87312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:03:37 devstack sudo[87312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:38 devstack sudo[87312]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.580s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:03:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Driver initialization completed successfully. Jul 06 21:03:38 devstack cinder-volume[87273]: INFO cinder.manager [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Initiating service 3 cleanup Jul 06 21:03:38 devstack cinder-volume[87273]: INFO cinder.manager [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Service 3 cleanup completed. Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG cinder.service [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Creating RPC server for service cinder-volume {{(pid=87273) start /opt/stack/cinder/cinder/service.py:231}} Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG cinder.service [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87273) start /opt/stack/cinder/cinder/service.py:237}} Jul 06 21:03:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.14) Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:03:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:03:38 devstack sudo[87319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:03:38 devstack sudo[87319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:03:39 devstack sudo[87319]: pam_unix(sudo:session): session closed for user root Jul 06 21:03:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.616s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:03:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ba77ad07-c15f-4eb5-aef6-4d5d78df2781 None None] Driver post RPC initialization completed successfully. Jul 06 21:03:46 devstack cinder-volume[86997]: DEBUG dbcounter [-] [86997] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86997) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:47 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:49 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:03:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3bd258aa-837a-46ca-a8ea-986593402867 tempest-BackendsCapabilitiesAdminTestsJSON-1489377075 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6654739379883, 'free_capacity_gb': 1775.6654739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87273) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 21:04:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a75791b7-7c1a-4d2a-ab70-1feeeaea049a tempest-BackendsCapabilitiesAdminTestsJSON-1489377075 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6654739379883, 'free_capacity_gb': 1775.6654739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87273) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 21:04:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:04:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 6 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:04:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:04:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-118b6169-12c8-43cd-aadf-2313b7430145 tempest-GroupSnapshotsTest-1713079612 None] Group tempest-GroupSnapshotsTest-Group-1425656481: creating Jul 06 21:04:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-118b6169-12c8-43cd-aadf-2313b7430145 tempest-GroupSnapshotsTest-1713079612 None] Group tempest-GroupSnapshotsTest-Group-1425656481: created successfully Jul 06 21:04:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-118b6169-12c8-43cd-aadf-2313b7430145 tempest-GroupSnapshotsTest-1713079612 None] Create group completed successfully. Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (c952abc8-c00e-450c-8077-8d16e6080def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a57e06-f0b0-43f2-b70c-74a9826ea585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (25a57e06-f0b0-43f2-b70c-74a9826ea585) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723308078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a8a5131-78e8-46cb-89cf-52c95db6daf8,host='devstack@QuobyteHD#QuobyteHD',id=3c0dd418-35af-403d-8bb7-b750f12cf63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:04:37Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5b1e9ea-70af-4e4a-9c46-7b91bc7db149),volume_type_id=e5b1e9ea-70af-4e4a-9c46-7b91bc7db149)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4779713-02c5-4891-8602-abb664887cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4779713-02c5-4891-8602-abb664887cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ccf3ca-b848-45ce-b2fe-17176c7a46d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ccf3ca-b848-45ce-b2fe-17176c7a46d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c0dd418-35af-403d-8bb7-b750f12cf63b', 'volume_name': 'volume-3c0dd418-35af-403d-8bb7-b750f12cf63b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec777bae-9182-47da-ab90-3533ed367106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ec777bae-9182-47da-ab90-3533ed367106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91ae5d3-d378-4f2d-a8f4-0b92d6472b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:37 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Volume 3c0dd418-35af-403d-8bb7-b750f12cf63b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c0dd418-35af-403d-8bb7-b750f12cf63b', 'volume_size': 1} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0a8a5131-78e8-46cb-89cf-52c95db6daf8,created_at=2026-07-06T19:04:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-723308078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0a8a5131-78e8-46cb-89cf-52c95db6daf8,host='devstack@QuobyteHD#QuobyteHD',id=3c0dd418-35af-403d-8bb7-b750f12cf63b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:04:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:04:37Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e5b1e9ea-70af-4e4a-9c46-7b91bc7db149),volume_type_id=e5b1e9ea-70af-4e4a-9c46-7b91bc7db149)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Creating volume 3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:04:37 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:04:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:37 devstack sudo[87637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b 1073741824 Jul 06 21:04:37 devstack sudo[87637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:39 devstack sudo[87637]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b 1073741824" returned: 0 in 1.636s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:39 devstack sudo[87963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b Jul 06 21:04:39 devstack sudo[87963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Flow 'volume_create_manager' (548cca82-7e55-412d-82b8-f4d9b0852f59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dbd93b-86bc-439e-93a3-def077a28f1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3dbd93b-86bc-439e-93a3-def077a28f1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1744247246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a94f775-ac12-4f24-a218-3118931a0035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a268a3bf09e14c4bb879cfd0c80ba995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:04:39Z,use_quota=True,user_id='f772e09073214c2c939ba37043f86fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10024fd-7fb2-4f24-a4d7-d5e05a9128ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c10024fd-7fb2-4f24-a4d7-d5e05a9128ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee12bf5-794c-4af1-bba9-e7dd5ecd1d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ee12bf5-794c-4af1-bba9-e7dd5ecd1d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a94f775-ac12-4f24-a218-3118931a0035', 'volume_name': 'volume-3a94f775-ac12-4f24-a218-3118931a0035', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a8d1a3-2ed7-4f08-a3ed-b8e0fe8d5014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5a8d1a3-2ed7-4f08-a3ed-b8e0fe8d5014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021d923a-9bef-4168-936b-988582ae5789) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:39 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Volume 3a94f775-ac12-4f24-a218-3118931a0035: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a94f775-ac12-4f24-a218-3118931a0035', 'volume_size': 1} Jul 06 21:04:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:40 devstack sudo[87963]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b" returned: 0 in 0.965s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] <== create_volume: return (2689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.691s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.517s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:04:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1744247246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a94f775-ac12-4f24-a218-3118931a0035,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a268a3bf09e14c4bb879cfd0c80ba995',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:04:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:04:39Z,use_quota=True,user_id='f772e09073214c2c939ba37043f86fc1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Creating volume 3a94f775-ac12-4f24-a218-3118931a0035 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:04:40 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:40 devstack sudo[87974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 1073741824 Jul 06 21:04:40 devstack sudo[87974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b91ae5d3-d378-4f2d-a8f4-0b92d6472b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c0dd418-35af-403d-8bb7-b750f12cf63b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49a1b93-5b4d-4017-a508-1cba2e6cd721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:40 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Volume volume-3c0dd418-35af-403d-8bb7-b750f12cf63b (3c0dd418-35af-403d-8bb7-b750f12cf63b): created successfully Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b49a1b93-5b4d-4017-a508-1cba2e6cd721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (c952abc8-c00e-450c-8077-8d16e6080def) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:04:40 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0a56789f-3207-435c-9363-71078bad508c tempest-GroupSnapshotsTest-1713079612 None] Created volume successfully. Jul 06 21:04:41 devstack sudo[87974]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 1073741824" returned: 0 in 1.621s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] GroupSnapshot 550919e0-4cc4-4ef1-b325-b8763f4023be: creating. Jul 06 21:04:42 devstack sudo[87991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 Jul 06 21:04:42 devstack sudo[87991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Group snapshot 550919e0-4cc4-4ef1-b325-b8763f4023be: creating. {{(pid=87273) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 21:04:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:42 devstack sudo[87991]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035" returned: 0 in 0.965s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] <== create_volume: return (2667ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:04:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.670s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.839s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (021d923a-9bef-4168-936b-988582ae5789) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a94f775-ac12-4f24-a218-3118931a0035', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6e7b6-2e23-4a9c-b3c9-7513b991f45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:04:43 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Volume volume-3a94f775-ac12-4f24-a218-3118931a0035 (3a94f775-ac12-4f24-a218-3118931a0035): created successfully Jul 06 21:04:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7cc6e7b6-2e23-4a9c-b3c9-7513b991f45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:04:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Flow 'volume_create_manager' (548cca82-7e55-412d-82b8-f4d9b0852f59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:04:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Creating offline snapshot 5e95a107-903d-4649-9aaf-09f94a86c6b0 of volume 3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:04:43 devstack cinder-volume[87273]: INFO oslo.privsep.daemon [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp40oeomcs/privsep.sock'] Jul 06 21:04:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-baa81e07-76a2-4f04-b8be-2015c4116a9d tempest-DeleteServersTestJSON-1947517976 None] Created volume successfully. Jul 06 21:04:43 devstack sudo[87997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp40oeomcs/privsep.sock Jul 06 21:04:43 devstack sudo[87997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_rootwrap/__init__.py:25: EventletDeprecationWarning: Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 21:04:43 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet.patcher Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_utils/importutils.py:77: EventletDeprecationWarning: Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: Jul 06 21:04:44 devstack cinder-volume[87273]: WARNING oslo.privsep.daemon [-] privsep log: __import__(import_str) Jul 06 21:04:45 devstack sudo[87997]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:45 devstack cinder-volume[87273]: INFO oslo.privsep.daemon [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Spawned new privsep daemon via rootwrap Jul 06 21:04:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Accepted privsep connection to /tmp/tmp40oeomcs/privsep.sock {{(pid=87273) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Jul 06 21:04:45 devstack cinder-volume[87273]: INFO oslo.privsep.daemon [-] privsep daemon starting Jul 06 21:04:45 devstack cinder-volume[87273]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Jul 06 21:04:45 devstack cinder-volume[87273]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Jul 06 21:04:45 devstack cinder-volume[87273]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88011 Jul 06 21:04:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a15007eb-8732-4d67-9e0e-f5aa0d78fb90]: (2,) {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:04:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[42961774-a7d4-42f1-8e90-f9a90df0ffe0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:04:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:45 devstack sudo[88015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b Jul 06 21:04:45 devstack sudo[88015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:46 devstack sudo[88015]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b" returned: 0 in 0.998s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:46 devstack sudo[88057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 1G Jul 06 21:04:46 devstack sudo[88057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:47 devstack sudo[88057]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 1G" returned: 0 in 1.299s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0dd418-35af-403d-8bb7-b750f12cf63b -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:47 devstack sudo[88072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0dd418-35af-403d-8bb7-b750f12cf63b -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 Jul 06 21:04:47 devstack sudo[88072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:48 devstack sudo[88072]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3c0dd418-35af-403d-8bb7-b750f12cf63b -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0" returned: 0 in 1.261s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:48 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:04:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:48 devstack sudo[88096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 Jul 06 21:04:48 devstack sudo[88096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:49 devstack sudo[88096]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0" returned: 0 in 0.777s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:49 devstack sudo[88110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.info Jul 06 21:04:49 devstack sudo[88110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:50 devstack sudo[88110]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.info" returned: 0 in 0.873s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:50 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:04:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:50 devstack sudo[88120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.info Jul 06 21:04:50 devstack sudo[88120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:50 devstack cinder-volume[87273]: WARNING py.warnings [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Jul 06 21:04:50 devstack cinder-volume[87273]: .first() Jul 06 21:04:50 devstack cinder-volume[87273]: Jul 06 21:04:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:51 devstack sudo[88120]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.info" returned: 0 in 0.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 8.090s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.408s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b51c764-81ae-4bda-aeed-6c52e8855be3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:04:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-21f836e1-ad05-422d-800d-c9156b5e73e2 tempest-GroupSnapshotsTest-1713079612 None] group_snapshot 550919e0-4cc4-4ef1-b325-b8763f4023be: created successfully Jul 06 21:04:51 devstack sudo[88132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 Jul 06 21:04:51 devstack sudo[88132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:52 devstack sudo[88132]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035" returned: 0 in 0.981s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.014s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-3a94f775-ac12-4f24-a218-3118931a0035', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63c1bdbb-0e20-4fd9-9f24-996ac3a0d60f', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:04:52 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-45ff07c3-f24a-460c-aa0b-836b4b487f50 req-7c8e2e12-c866-432c-92d1-29c0d8414fbd tempest-DeleteServersTestJSON-1947517976 None] attachment_update completed successfully. Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-5e95a107-903d-4649-9aaf-09f94a86c6b0-f3e6d869-9484-4d88-a58e-50ddced5caf4" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5e95a107-903d-4649-9aaf-09f94a86c6b0-f3e6d869-9484-4d88-a58e-50ddced5caf4" acquired by "_create_volume_from_snapshot" :: waited 0.036s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Creating volume f3e6d869-9484-4d88-a58e-50ddced5caf4 from snapshot 5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-f3e6d869-9484-4d88-a58e-50ddced5caf4" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-f3e6d869-9484-4d88-a58e-50ddced5caf4" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] snapshot: 5e95a107-903d-4649-9aaf-09f94a86c6b0, volume: f3e6d869-9484-4d88-a58e-50ddced5caf4, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d66a00-13ab-412f-87b8-6cedf1bc71d2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:04:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:53 devstack sudo[88245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 Jul 06 21:04:53 devstack sudo[88245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:54 devstack sudo[88245]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0" returned: 0 in 1.285s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c0dd418-35af-403d-8bb7-b750f12cf63b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:04:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:04:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:04:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5575d2-263c-4597-bd3f-90a6b255432d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:04:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:55 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b Jul 06 21:04:55 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:04:56 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Jul 06 21:04:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b" returned: 0 in 1.469s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:04:56 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:04:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:04:56 devstack sudo[88623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 Jul 06 21:04:56 devstack sudo[88623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:05:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:01 devstack sudo[88700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:01 devstack sudo[88700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:02 devstack sudo[88700]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.653s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:05:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:05:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Flow 'volume_create_manager' (a5bbd3b9-4317-4181-b133-b8cecae1ebf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f8b872-aca0-4b7b-a562-b2ebffeb5615) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f8b872-aca0-4b7b-a562-b2ebffeb5615) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-98950193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944cb4a5-fdb5-48a3-9ad2-d683817044ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb787adc4fd42069ab0f9190860209f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:03Z,use_quota=True,user_id='8e45bf1a883d46feb58bdcf06deda7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec91b98d-cb07-4622-9e79-0be814a058c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec91b98d-cb07-4622-9e79-0be814a058c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81e897d-3ae7-479a-997a-ba554a034068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a81e897d-3ae7-479a-997a-ba554a034068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '944cb4a5-fdb5-48a3-9ad2-d683817044ba', 'volume_name': 'volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcaf3e3-ec18-40b0-8d53-ca78b035bdde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6fcaf3e3-ec18-40b0-8d53-ca78b035bdde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2049366-ffd6-42b5-834e-f0b5c7ad5b98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Volume 944cb4a5-fdb5-48a3-9ad2-d683817044ba: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba', 'volume_size': 1} Jul 06 21:05:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-734a1a64-53b6-47be-963b-015e4c0ac805 req-f1eee8ca-1723-4d1c-8b91-786fcfa0d41c tempest-DeleteServersTestJSON-1947517976 None] Terminate volume connection completed successfully. Jul 06 21:05:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-734a1a64-53b6-47be-963b-015e4c0ac805 req-f1eee8ca-1723-4d1c-8b91-786fcfa0d41c tempest-DeleteServersTestJSON-1947517976 None] Deleting attachment 63c1bdbb-0e20-4fd9-9f24-996ac3a0d60f. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:05:05 devstack sudo[88623]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4" returned: 0 in 9.539s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:05 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc3bd2f5-1c34-42aa-a608-9050be2075d2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:06 devstack sudo[88715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b Jul 06 21:05:06 devstack sudo[88715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:06 devstack sudo[88715]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b" returned: 0 in 1.043s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:06 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b, size 1024.00 MB, duration 9.54 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:05:06 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Converted 1024.00 MB image at 107.34 MB/s Jul 06 21:05:06 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:05:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:06 devstack sudo[88720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 Jul 06 21:05:06 devstack sudo[88720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:07 devstack sudo[88720]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4" returned: 0 in 0.724s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-f3e6d869-9484-4d88-a58e-50ddced5caf4" released by "_copy_volume_from_snapshot" :: held 14.241s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5e95a107-903d-4649-9aaf-09f94a86c6b0-f3e6d869-9484-4d88-a58e-50ddced5caf4" released by "_create_volume_from_snapshot" :: held 14.295s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.333s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.210s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-98950193',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=944cb4a5-fdb5-48a3-9ad2-d683817044ba,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3cb787adc4fd42069ab0f9190860209f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:03Z,use_quota=True,user_id='8e45bf1a883d46feb58bdcf06deda7a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Creating volume 944cb4a5-fdb5-48a3-9ad2-d683817044ba {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:05:07 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:05:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:07 devstack sudo[88724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba 1073741824 Jul 06 21:05:07 devstack sudo[88724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c81d83aa-bf7c-45d3-825a-832485fa2463 tempest-GroupSnapshotsTest-1713079612 None] Create group from source-snapshot-550919e0-4cc4-4ef1-b325-b8763f4023be completed successfully. Jul 06 21:05:08 devstack sudo[88724]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba 1073741824" returned: 0 in 1.206s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:08 devstack sudo[88730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba Jul 06 21:05:08 devstack sudo[88730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-f3e6d869-9484-4d88-a58e-50ddced5caf4" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-f3e6d869-9484-4d88-a58e-50ddced5caf4" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7962054-bc15-42fa-a864-087116b73b62]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:09 devstack sudo[88730]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba" returned: 0 in 1.022s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] <== create_volume: return (2294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:05:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.303s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2049366-ffd6-42b5-834e-f0b5c7ad5b98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888e5b11-c0b5-4daa-9c7a-09c0ec6ce683) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:10 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Volume volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba (944cb4a5-fdb5-48a3-9ad2-d683817044ba): created successfully Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (888e5b11-c0b5-4daa-9c7a-09c0ec6ce683) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Flow 'volume_create_manager' (a5bbd3b9-4317-4181-b133-b8cecae1ebf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:10 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c34d6b2f-c908-4208-8c3e-7d4e599098c6 tempest-VolumesAdminNegativeTest-1205906279 None] Created volume successfully. Jul 06 21:05:10 devstack sudo[88754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 Jul 06 21:05:10 devstack sudo[88754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Acquiring lock "cinder-3a94f775-ac12-4f24-a218-3118931a0035-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Lock "cinder-3a94f775-ac12-4f24-a218-3118931a0035-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Acquiring lock "cinder-quobyte-3a94f775-ac12-4f24-a218-3118931a0035" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Lock "cinder-quobyte-3a94f775-ac12-4f24-a218-3118931a0035" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bce39af-94b3-4dfd-9152-6af2c3e04f2f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:10 devstack sudo[88756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 Jul 06 21:05:10 devstack sudo[88756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:10 devstack sudo[88754]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4" returned: 0 in 0.990s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:10 devstack sudo[88761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4 Jul 06 21:05:10 devstack sudo[88761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Acquiring lock "cinder-944cb4a5-fdb5-48a3-9ad2-d683817044ba-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "cinder-944cb4a5-fdb5-48a3-9ad2-d683817044ba-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Acquiring lock "cinder-quobyte-944cb4a5-fdb5-48a3-9ad2-d683817044ba" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "cinder-quobyte-944cb4a5-fdb5-48a3-9ad2-d683817044ba" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:11 devstack sudo[88756]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035" returned: 0 in 1.023s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e6e7eee-b763-4287-8ed6-e203f26c775e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:11 devstack sudo[88766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035 Jul 06 21:05:11 devstack sudo[88766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:11 devstack sudo[88767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba Jul 06 21:05:11 devstack sudo[88767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:11 devstack sudo[88761]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f3e6d869-9484-4d88-a58e-50ddced5caf4" returned: 0 in 0.974s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-f3e6d869-9484-4d88-a58e-50ddced5caf4" released by "delete_volume" :: held 2.035s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['936dbb47-1445-4be5-b59c-ef92f5446224'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:12 devstack cinder-volume[87273]: WARNING cinder.quota [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1844653091 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1844653091, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:05:12 devstack cinder-volume[87273]: WARNING cinder.quota [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1844653091 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1844653091, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['8bc66d97-66f2-484b-9442-3445ea91ec39', '8e89498b-4fda-4910-991d-afb2adc3598e', '1c76a7ec-5343-42f8-b5bf-7224e5b4987c', 'a14dc09a-e79c-4ff6-a94b-88d63d141e82'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:12 devstack sudo[88766]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a94f775-ac12-4f24-a218-3118931a0035" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:12 devstack sudo[88775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:12 devstack sudo[88775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Lock "cinder-quobyte-3a94f775-ac12-4f24-a218-3118931a0035" released by "delete_volume" :: held 1.901s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:12 devstack cinder-volume[87273]: WARNING cinder.quota [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:05:12 devstack cinder-volume[87273]: WARNING cinder.quota [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Created reservations ['439eb443-09ce-4901-9f81-a150e9d509a1', 'b304a286-d49d-4d56-9145-e7ea9fd2779f', '35cd5fa8-5984-4127-a104-3ccac83e8e3b', '4e0ccdd3-4ddc-41ad-bc75-477527c3b796'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:12 devstack sudo[88767]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba" returned: 0 in 1.118s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:12 devstack sudo[88777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:12 devstack sudo[88777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] group_snapshot 550919e0-4cc4-4ef1-b325-b8763f4023be: deleting Jul 06 21:05:12 devstack sudo[88778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba Jul 06 21:05:12 devstack sudo[88778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] group_snapshot 550919e0-4cc4-4ef1-b325-b8763f4023be: deleting {{(pid=87273) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-3c0dd418-35af-403d-8bb7-b750f12cf63b" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-3c0dd418-35af-403d-8bb7-b750f12cf63b" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-5e95a107-903d-4649-9aaf-09f94a86c6b0" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5e95a107-903d-4649-9aaf-09f94a86c6b0" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Deleting offline snapshot 5e95a107-903d-4649-9aaf-09f94a86c6b0 of volume 3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] snapshot_file for this snap is: volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6785c55-6e86-4489-bb8a-af14adc8ec23]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:13 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 Jul 06 21:05:13 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:13 devstack sudo[88775]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.216s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6b283937-9d9b-487c-8dee-677bddded2f2 tempest-GroupSnapshotsTest-1713079612 None] Delete group completed successfully. Jul 06 21:05:13 devstack sudo[88778]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-944cb4a5-fdb5-48a3-9ad2-d683817044ba" returned: 0 in 1.165s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "cinder-quobyte-944cb4a5-fdb5-48a3-9ad2-d683817044ba" released by "delete_volume" :: held 2.359s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:13 devstack sudo[88777]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.268s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Deleted volume successfully. Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Created reservations ['0b8ab204-d227-41ba-a0df-77c97eeebe6d', '4579ab92-e8d9-4ea4-b403-7fca233edf0f', 'f6130438-64d4-473a-86a2-07f5c1afc904', '907b4e45-6d77-4694-a59b-45c47bb86ddb'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-363b7da7-f639-40c7-9132-e63956f0c2c7 tempest-DeleteServersTestJSON-1947517976 None] Lock "cinder-3a94f775-ac12-4f24-a218-3118931a0035-delete_volume" released by "delete_volume" :: held 3.563s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:14 devstack sudo[88789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:14 devstack sudo[88789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:14 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0" returned: 0 in 1.228s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3c0dd418-35af-403d-8bb7-b750f12cf63b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3719151-250f-487c-9f59-4f6676eb0d21]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:14 devstack sudo[88795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b Jul 06 21:05:14 devstack sudo[88795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:14 devstack sudo[88789]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.764s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Deleted volume successfully. Jul 06 21:05:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-221fd19c-7319-4b37-a8f7-2ee338d13ae7 tempest-VolumesAdminNegativeTest-1205906279 None] Lock "cinder-944cb4a5-fdb5-48a3-9ad2-d683817044ba-delete_volume" released by "delete_volume" :: held 3.462s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:15 devstack sudo[88795]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b" returned: 0 in 0.930s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:15 devstack sudo[88803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 Jul 06 21:05:15 devstack sudo[88803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:16 devstack sudo[88803]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0" returned: 0 in 0.959s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:16 devstack sudo[88809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0 Jul 06 21:05:16 devstack sudo[88809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:17 devstack sudo[88809]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b.5e95a107-903d-4649-9aaf-09f94a86c6b0" returned: 0 in 0.933s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5e95a107-903d-4649-9aaf-09f94a86c6b0" released by "_delete_snapshot" :: held 4.259s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-3c0dd418-35af-403d-8bb7-b750f12cf63b" released by "delete_snapshot" :: held 4.298s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:17 devstack cinder-volume[87273]: WARNING cinder.quota [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1844653091 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1844653091, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:05:17 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['8a776ebf-7ee4-4d9b-b484-0cf591f68f39', 'ba4b3337-ce22-4786-83ce-78183d892b75', 'f41fd2da-75f4-40e9-beb4-0ee5ea33985f', 'efffe25c-860f-4e1b-b82d-23ee60875149'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f78c9046-d220-4c2b-a4bd-b4f188a5320f tempest-GroupSnapshotsTest-1713079612 None] group_snapshot 550919e0-4cc4-4ef1-b325-b8763f4023be: deleted successfully Jul 06 21:05:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-3c0dd418-35af-403d-8bb7-b750f12cf63b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-3c0dd418-35af-403d-8bb7-b750f12cf63b" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[98651f61-cb13-4135-83bf-e9d151733a9e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:18 devstack sudo[88838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b Jul 06 21:05:18 devstack sudo[88838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:19 devstack sudo[88838]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b" returned: 0 in 1.006s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:19 devstack sudo[88846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b Jul 06 21:05:19 devstack sudo[88846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:20 devstack sudo[88846]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3c0dd418-35af-403d-8bb7-b750f12cf63b" returned: 0 in 0.911s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-3c0dd418-35af-403d-8bb7-b750f12cf63b" released by "delete_volume" :: held 2.006s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:20 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['18aa460b-bea0-4a39-8b38-4d2e4b2fc737'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:20 devstack cinder-volume[87273]: WARNING cinder.db.api [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-1844653091'] Jul 06 21:05:20 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['4448ec37-848f-4c6a-ad5c-1346eac79dfe', '14496c36-e3a2-4db6-94a3-f4df6bad04f7', 'dfb636cd-c97c-4053-a0c5-24b302131b90', '1fbcd183-772f-4fbb-9cac-023e2f38dd24'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:21 devstack sudo[88849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:21 devstack sudo[88849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1532737d-8716-414e-a764-e393e9607218 tempest-GroupSnapshotsTest-1713079612 None] Group tempest-GroupSnapshotsTest-Group-2051460210: creating Jul 06 21:05:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1532737d-8716-414e-a764-e393e9607218 tempest-GroupSnapshotsTest-1713079612 None] Group tempest-GroupSnapshotsTest-Group-2051460210: created successfully Jul 06 21:05:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1532737d-8716-414e-a764-e393e9607218 tempest-GroupSnapshotsTest-1713079612 None] Create group completed successfully. Jul 06 21:05:21 devstack sudo[88849]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.851s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:21 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2a695dff-25d6-4152-8d5b-9abde83c6596 tempest-GroupSnapshotsTest-1713079612 None] Delete group completed successfully. Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (9d741805-340b-480d-a983-347ac02c1ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99743c3-7696-4dd5-85f9-444cf2ef099d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c99743c3-7696-4dd5-85f9-444cf2ef099d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1845864845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dffe49d0-8f76-431a-8678-ed53524cf344,host='devstack@QuobyteHD#QuobyteHD',id=71fb8d39-63e0-4740-9c75-92d5a44969f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:24Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5dedcb-79ab-4829-bd31-50e367775e06),volume_type_id=3e5dedcb-79ab-4829-bd31-50e367775e06)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d14b54d-0494-4865-ab47-da9f20a38d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d14b54d-0494-4865-ab47-da9f20a38d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b694476-1bce-49d5-a08c-b7810a3185d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b694476-1bce-49d5-a08c-b7810a3185d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71fb8d39-63e0-4740-9c75-92d5a44969f2', 'volume_name': 'volume-71fb8d39-63e0-4740-9c75-92d5a44969f2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c581ea-db7e-4b69-872b-7d42dd409de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15c581ea-db7e-4b69-872b-7d42dd409de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5af61a3-09ef-4fee-9c34-06652c864146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Volume 71fb8d39-63e0-4740-9c75-92d5a44969f2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71fb8d39-63e0-4740-9c75-92d5a44969f2', 'volume_size': 1} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dffe49d0-8f76-431a-8678-ed53524cf344,created_at=2026-07-06T19:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1845864845',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dffe49d0-8f76-431a-8678-ed53524cf344,host='devstack@QuobyteHD#QuobyteHD',id=71fb8d39-63e0-4740-9c75-92d5a44969f2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:24Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5dedcb-79ab-4829-bd31-50e367775e06),volume_type_id=3e5dedcb-79ab-4829-bd31-50e367775e06)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Creating volume 71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:05:23 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:05:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:23 devstack sudo[88860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 1073741824 Jul 06 21:05:23 devstack sudo[88860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:24 devstack sudo[88860]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 1073741824" returned: 0 in 1.064s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:24 devstack sudo[88867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 Jul 06 21:05:24 devstack sudo[88867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:25 devstack sudo[88867]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2" returned: 0 in 0.781s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:05:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.905s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5af61a3-09ef-4fee-9c34-06652c864146) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71fb8d39-63e0-4740-9c75-92d5a44969f2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aebaf4a-692e-4a93-92a2-002a1fc9b616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:25 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Volume volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 (71fb8d39-63e0-4740-9c75-92d5a44969f2): created successfully Jul 06 21:05:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9aebaf4a-692e-4a93-92a2-002a1fc9b616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (9d741805-340b-480d-a983-347ac02c1ce5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-97b54da5-3d39-46f2-9c51-d2a0397dcfdb tempest-GroupSnapshotsTest-1713079612 None] Created volume successfully. Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Flow 'volume_create_manager' (d7cfacd8-e27c-4c29-86bb-a1836c7162ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7182197a-a55b-4c27-9330-6c034729938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7182197a-a55b-4c27-9330-6c034729938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-173258293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147d0809-becb-4374-b42e-faf58868331c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf11cb95bb4456a8c82cb599940a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:26Z,use_quota=True,user_id='bb9218f5df5347a6b92719aa1e1b5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e0c58f-15fa-45dc-8b08-8e9b7595a441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49e0c58f-15fa-45dc-8b08-8e9b7595a441) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32ed080-1bed-489b-b6f9-1c2f6a745bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c32ed080-1bed-489b-b6f9-1c2f6a745bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '147d0809-becb-4374-b42e-faf58868331c', 'volume_name': 'volume-147d0809-becb-4374-b42e-faf58868331c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b21d51d-00bd-4107-b4cd-ac18aecb4f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b21d51d-00bd-4107-b4cd-ac18aecb4f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29528f12-460a-4bd3-91e8-22380acfb694) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Volume 147d0809-becb-4374-b42e-faf58868331c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-147d0809-becb-4374-b42e-faf58868331c', 'volume_size': 1} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-173258293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=147d0809-becb-4374-b42e-faf58868331c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf11cb95bb4456a8c82cb599940a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:26Z,use_quota=True,user_id='bb9218f5df5347a6b92719aa1e1b5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Creating volume 147d0809-becb-4374-b42e-faf58868331c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:05:26 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:26 devstack sudo[88870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c 1073741824 Jul 06 21:05:26 devstack sudo[88870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (a1650c0a-4320-445b-ad6a-1d8b3a51a77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de396d15-e52b-43b7-ba4f-e96ca2155c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (de396d15-e52b-43b7-ba4f-e96ca2155c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173773750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dffe49d0-8f76-431a-8678-ed53524cf344,host='devstack@QuobyteHD#QuobyteHD',id=5c052218-c1b3-48ad-b265-7327ddc71a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:27Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5dedcb-79ab-4829-bd31-50e367775e06),volume_type_id=3e5dedcb-79ab-4829-bd31-50e367775e06)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c402506-b937-49f0-ad32-72b1ef363fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9c402506-b937-49f0-ad32-72b1ef363fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec723d5-8ca7-4f9d-928f-1cb5b8169dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec723d5-8ca7-4f9d-928f-1cb5b8169dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c052218-c1b3-48ad-b265-7327ddc71a6f', 'volume_name': 'volume-5c052218-c1b3-48ad-b265-7327ddc71a6f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8278367-4fed-43fc-b7c4-57601512b482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e8278367-4fed-43fc-b7c4-57601512b482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd734601-95f1-4cd7-8036-927c354c3743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:26 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Volume 5c052218-c1b3-48ad-b265-7327ddc71a6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c052218-c1b3-48ad-b265-7327ddc71a6f', 'volume_size': 1} Jul 06 21:05:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:27 devstack sudo[88870]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c 1073741824" returned: 0 in 1.069s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:27 devstack sudo[88877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c Jul 06 21:05:27 devstack sudo[88877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:28 devstack sudo[88877]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c" returned: 0 in 0.754s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] <== create_volume: return (1873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.876s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.420s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=dffe49d0-8f76-431a-8678-ed53524cf344,created_at=2026-07-06T19:05:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1173773750',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=dffe49d0-8f76-431a-8678-ed53524cf344,host='devstack@QuobyteHD#QuobyteHD',id=5c052218-c1b3-48ad-b265-7327ddc71a6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:27Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3e5dedcb-79ab-4829-bd31-50e367775e06),volume_type_id=3e5dedcb-79ab-4829-bd31-50e367775e06)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Creating volume 5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:05:28 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=64,cinder:UPDATE=69,cinder:DELETE=3,cinder:INSERT=15 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29528f12-460a-4bd3-91e8-22380acfb694) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-147d0809-becb-4374-b42e-faf58868331c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:28 devstack sudo[88881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f 1073741824 Jul 06 21:05:28 devstack sudo[88881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91470137-7caf-4c72-a064-aa189d9c5c83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Volume volume-147d0809-becb-4374-b42e-faf58868331c (147d0809-becb-4374-b42e-faf58868331c): created successfully Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91470137-7caf-4c72-a064-aa189d9c5c83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Flow 'volume_create_manager' (d7cfacd8-e27c-4c29-86bb-a1836c7162ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d5f4737f-3fec-49df-88ce-bb4aa3ec0231 tempest-VolumesTestJSON-537601064 None] Created volume successfully. Jul 06 21:05:29 devstack sudo[88881]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f 1073741824" returned: 0 in 1.016s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:29 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=66,cinder:UPDATE=62,cinder:INSERT=13,cinder:DELETE=3 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:05:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:29 devstack sudo[88890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f Jul 06 21:05:29 devstack sudo[88890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:30 devstack sudo[88890]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f" returned: 0 in 0.931s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] <== create_volume: return (2017ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.021s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd734601-95f1-4cd7-8036-927c354c3743) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c052218-c1b3-48ad-b265-7327ddc71a6f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c952586-2419-48dc-a89d-5dee93cc0bb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Volume volume-5c052218-c1b3-48ad-b265-7327ddc71a6f (5c052218-c1b3-48ad-b265-7327ddc71a6f): created successfully Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2c952586-2419-48dc-a89d-5dee93cc0bb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (a1650c0a-4320-445b-ad6a-1d8b3a51a77a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Flow 'volume_create_manager' (260441a2-d946-4da4-adb9-a70177b6db24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771256b2-98e0-4ffe-b784-87c677ecc014) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-270440f2-7724-4e45-97f3-c0391ff722f6 tempest-GroupSnapshotsTest-1713079612 None] Created volume successfully. Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (771256b2-98e0-4ffe-b784-87c677ecc014) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-620612145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34bd266-b198-49e9-8ee6-6d157958d0a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf11cb95bb4456a8c82cb599940a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:30Z,use_quota=True,user_id='bb9218f5df5347a6b92719aa1e1b5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d86123c-8fd8-4880-8f7d-deb8c86e5d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8d86123c-8fd8-4880-8f7d-deb8c86e5d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84a69d8-3f06-422b-9bcd-b02d9c7f3ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e84a69d8-3f06-422b-9bcd-b02d9c7f3ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f34bd266-b198-49e9-8ee6-6d157958d0a2', 'volume_name': 'volume-f34bd266-b198-49e9-8ee6-6d157958d0a2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8374a9-5e11-4268-9830-fa66b1aa14c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a8374a9-5e11-4268-9830-fa66b1aa14c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f65ea0-4bab-411f-8e8f-66e79d9cba34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Volume f34bd266-b198-49e9-8ee6-6d157958d0a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f34bd266-b198-49e9-8ee6-6d157958d0a2', 'volume_size': 1} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-620612145',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f34bd266-b198-49e9-8ee6-6d157958d0a2,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf11cb95bb4456a8c82cb599940a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:30Z,use_quota=True,user_id='bb9218f5df5347a6b92719aa1e1b5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Creating volume f34bd266-b198-49e9-8ee6-6d157958d0a2 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:05:30 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:05:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:30 devstack sudo[88910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 1073741824 Jul 06 21:05:30 devstack sudo[88910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:31 devstack sudo[88910]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 1073741824" returned: 0 in 1.012s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:31 devstack sudo[88919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 Jul 06 21:05:31 devstack sudo[88919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d1a6ce0a-878f-47da-9582-7cd614057293 tempest-GroupSnapshotsTest-1713079612 None] Update group completed successfully. Jul 06 21:05:32 devstack sudo[88919]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2" returned: 0 in 0.720s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] <== create_volume: return (1791ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:05:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.793s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87f65ea0-4bab-411f-8e8f-66e79d9cba34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f34bd266-b198-49e9-8ee6-6d157958d0a2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85943aad-066e-4fc3-852a-8e1746756de4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:32 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Volume volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 (f34bd266-b198-49e9-8ee6-6d157958d0a2): created successfully Jul 06 21:05:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (85943aad-066e-4fc3-852a-8e1746756de4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Flow 'volume_create_manager' (260441a2-d946-4da4-adb9-a70177b6db24) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e208947d-6431-467b-ac8a-c78a67da994e tempest-VolumesTestJSON-537601064 None] Created volume successfully. Jul 06 21:05:33 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2c6fd619-b9d1-4c40-94a5-7d484407de4b tempest-GroupSnapshotsTest-1713079612 None] Update group completed successfully. Jul 06 21:05:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-692ae4de-c6fe-43a3-ade1-97148cd83005 tempest-GroupSnapshotsTest-1713079612 None] Update group completed successfully. Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Flow 'volume_create_manager' (7a9bb75c-627e-49e4-86c9-cdab9d95e908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453d8420-161e-4322-ae68-97ad7985a240) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (453d8420-161e-4322-ae68-97ad7985a240) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1865005023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1038e93f-b784-4567-8269-b1f53e9faba5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf11cb95bb4456a8c82cb599940a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:34Z,use_quota=True,user_id='bb9218f5df5347a6b92719aa1e1b5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08aae3c6-7e91-4a61-a763-723eb75d903a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08aae3c6-7e91-4a61-a763-723eb75d903a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b4c331-bd56-4b42-a4d0-b5a1b052af56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b4c331-bd56-4b42-a4d0-b5a1b052af56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1038e93f-b784-4567-8269-b1f53e9faba5', 'volume_name': 'volume-1038e93f-b784-4567-8269-b1f53e9faba5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b3a861-1053-467d-aeac-c225a18b0db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1b3a861-1053-467d-aeac-c225a18b0db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d88eb78-9b9c-4927-864b-ba692e715cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:34 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Volume 1038e93f-b784-4567-8269-b1f53e9faba5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1038e93f-b784-4567-8269-b1f53e9faba5', 'volume_size': 1} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:05:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1865005023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1038e93f-b784-4567-8269-b1f53e9faba5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='fcf11cb95bb4456a8c82cb599940a147',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:05:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:05:34Z,use_quota=True,user_id='bb9218f5df5347a6b92719aa1e1b5cbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Creating volume 1038e93f-b784-4567-8269-b1f53e9faba5 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:05:34 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:05:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:34 devstack sudo[88970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 1073741824 Jul 06 21:05:34 devstack sudo[88970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bf6b4e33-f378-4fee-9b7a-55213dda7842 tempest-GroupSnapshotsTest-1713079612 None] Update group completed successfully. Jul 06 21:05:35 devstack sudo[88970]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 1073741824" returned: 0 in 1.224s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:35 devstack sudo[88997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 Jul 06 21:05:35 devstack sudo[88997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:36 devstack sudo[88997]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5" returned: 0 in 0.779s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] <== create_volume: return (2060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:05:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.062s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d88eb78-9b9c-4927-864b-ba692e715cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1038e93f-b784-4567-8269-b1f53e9faba5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2aed44-ba91-4d6e-bd44-05e4ad3c30b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:05:36 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Volume volume-1038e93f-b784-4567-8269-b1f53e9faba5 (1038e93f-b784-4567-8269-b1f53e9faba5): created successfully Jul 06 21:05:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2aed44-ba91-4d6e-bd44-05e4ad3c30b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:05:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Flow 'volume_create_manager' (7a9bb75c-627e-49e4-86c9-cdab9d95e908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:05:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3e438c66-ff0c-4bc4-869a-cd34b515ef43 tempest-VolumesTestJSON-537601064 None] Created volume successfully. Jul 06 21:05:37 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] GroupSnapshot e8cebbd8-8e35-41ef-90da-a2c3ee055c15: creating. Jul 06 21:05:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Group snapshot e8cebbd8-8e35-41ef-90da-a2c3ee055c15: creating. {{(pid=87273) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 21:05:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Creating offline snapshot bd102dce-6e1c-4121-b538-a3a67e081a1c of volume 71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:05:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[221b1076-c683-4068-a561-65279cb5093b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:37 devstack sudo[89012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 Jul 06 21:05:37 devstack sudo[89012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:38 devstack sudo[89012]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2" returned: 0 in 1.292s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:38 devstack sudo[89054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c 1G Jul 06 21:05:38 devstack sudo[89054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Acquiring lock "cinder-1038e93f-b784-4567-8269-b1f53e9faba5-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Lock "cinder-1038e93f-b784-4567-8269-b1f53e9faba5-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Acquiring lock "cinder-quobyte-1038e93f-b784-4567-8269-b1f53e9faba5" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Lock "cinder-quobyte-1038e93f-b784-4567-8269-b1f53e9faba5" acquired by "delete_volume" :: waited 0.041s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8c40940-d462-446e-8e21-1f736343fc50]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:40 devstack sudo[89054]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c 1G" returned: 0 in 1.515s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:40 devstack sudo[89061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c Jul 06 21:05:40 devstack sudo[89061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:40 devstack sudo[89060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 Jul 06 21:05:40 devstack sudo[89060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:41 devstack sudo[89061]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c" returned: 0 in 1.348s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:41 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:05:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:41 devstack sudo[89073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c Jul 06 21:05:41 devstack sudo[89073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:41 devstack sudo[89060]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5" returned: 0 in 1.428s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:41 devstack sudo[89075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5 Jul 06 21:05:41 devstack sudo[89075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:42 devstack sudo[89073]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c" returned: 0 in 0.731s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:42 devstack sudo[89079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.info Jul 06 21:05:42 devstack sudo[89079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:42 devstack sudo[89075]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1038e93f-b784-4567-8269-b1f53e9faba5" returned: 0 in 0.901s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Lock "cinder-quobyte-1038e93f-b784-4567-8269-b1f53e9faba5" released by "delete_volume" :: held 2.422s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Created reservations ['f3cbf3ab-63c1-4ad9-ac41-c9fafecddc84', '5c72753a-e9b3-4b40-8344-c10f6846167d', '8316cb45-516e-4fc3-95fd-769799e1e2b1', 'dd265d86-7a08-4482-a096-11b45e224b20'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:42 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:42 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:43 devstack sudo[89079]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.info" returned: 0 in 1.050s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:43 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:43 devstack sudo[89084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.info Jul 06 21:05:43 devstack sudo[89084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Acquiring lock "cinder-f34bd266-b198-49e9-8ee6-6d157958d0a2-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Lock "cinder-f34bd266-b198-49e9-8ee6-6d157958d0a2-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Acquiring lock "cinder-quobyte-f34bd266-b198-49e9-8ee6-6d157958d0a2" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Lock "cinder-quobyte-f34bd266-b198-49e9-8ee6-6d157958d0a2" acquired by "delete_volume" :: waited 0.034s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e877aef1-fcd4-4595-9078-aae2e9bfb654]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:43 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.036s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Deleted volume successfully. Jul 06 21:05:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-588c282e-3de3-4219-8eae-939dafcb98e1 tempest-VolumesTestJSON-537601064 None] Lock "cinder-1038e93f-b784-4567-8269-b1f53e9faba5-delete_volume" released by "delete_volume" :: held 3.969s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:44 devstack sudo[89087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 Jul 06 21:05:44 devstack sudo[89087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:44 devstack sudo[89084]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.info" returned: 0 in 0.955s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.056s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Creating offline snapshot f37d85d4-37ef-4ee4-a776-314b8e81037b of volume 5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e0be42-c99e-4e2e-82dd-09b8e5036104]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:44 devstack sudo[89090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f Jul 06 21:05:44 devstack sudo[89090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:44 devstack sudo[89087]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2" returned: 0 in 1.191s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:44 devstack sudo[89095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2 Jul 06 21:05:44 devstack sudo[89095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:45 devstack sudo[89090]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f" returned: 0 in 0.968s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:45 devstack sudo[89101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b 1G Jul 06 21:05:45 devstack sudo[89101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:45 devstack sudo[89095]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f34bd266-b198-49e9-8ee6-6d157958d0a2" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Lock "cinder-quobyte-f34bd266-b198-49e9-8ee6-6d157958d0a2" released by "delete_volume" :: held 1.935s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Created reservations ['8bfd6f99-576d-4140-b86c-bcb6b7d60de5', 'e5af9133-0ff2-4dd7-a658-7c47f52399ca', '75fbfa7c-f9ea-41c6-9d9f-0a00e7a80b9e', 'd8d38d8f-b4b4-49d9-b152-cb26d46d2d0f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:45 devstack sudo[89104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:45 devstack sudo[89104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Acquiring lock "cinder-147d0809-becb-4374-b42e-faf58868331c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Lock "cinder-147d0809-becb-4374-b42e-faf58868331c-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Acquiring lock "cinder-quobyte-147d0809-becb-4374-b42e-faf58868331c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Lock "cinder-quobyte-147d0809-becb-4374-b42e-faf58868331c" acquired by "delete_volume" :: waited 0.037s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[963c0daf-7a14-4eec-a096-4f45ecec640c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:46 devstack sudo[89107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c Jul 06 21:05:46 devstack sudo[89107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:46 devstack sudo[89104]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:46 devstack sudo[89101]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.051s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b 1G" returned: 0 in 1.460s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c052218-c1b3-48ad-b265-7327ddc71a6f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Deleted volume successfully. Jul 06 21:05:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b02ba4c0-6c25-40ea-bbf4-d30db7c7878b tempest-VolumesTestJSON-537601064 None] Lock "cinder-f34bd266-b198-49e9-8ee6-6d157958d0a2-delete_volume" released by "delete_volume" :: held 3.326s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:46 devstack sudo[89113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c052218-c1b3-48ad-b265-7327ddc71a6f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b Jul 06 21:05:46 devstack sudo[89113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:47 devstack sudo[89107]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c" returned: 0 in 1.003s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:47 devstack sudo[89118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c Jul 06 21:05:47 devstack sudo[89118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:47 devstack sudo[89113]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5c052218-c1b3-48ad-b265-7327ddc71a6f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b" returned: 0 in 0.980s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:47 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:05:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:47 devstack sudo[89125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b Jul 06 21:05:47 devstack sudo[89125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:48 devstack sudo[89118]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-147d0809-becb-4374-b42e-faf58868331c" returned: 0 in 0.814s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Lock "cinder-quobyte-147d0809-becb-4374-b42e-faf58868331c" released by "delete_volume" :: held 1.884s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Created reservations ['3020c248-25f0-4ec3-833a-a2ae6745e475', '3e819d1f-86e4-4222-b92c-0fc2c301fdc1', '1491d734-dd4a-4ce0-8d62-28ccffaa1bec', '95926962-a40a-4321-a36b-2ad73de84903'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:48 devstack sudo[89128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:05:48 devstack sudo[89128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:48 devstack sudo[89125]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b" returned: 0 in 1.067s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:49 devstack sudo[89165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.info Jul 06 21:05:49 devstack sudo[89165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:49 devstack sudo[89128]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.823s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:49 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:05:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Deleted volume successfully. Jul 06 21:05:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-35076f2e-ab81-4869-8c1e-a8e2d39a1358 tempest-VolumesTestJSON-537601064 None] Lock "cinder-147d0809-becb-4374-b42e-faf58868331c-delete_volume" released by "delete_volume" :: held 3.095s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:49 devstack sudo[89165]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.info" returned: 0 in 0.836s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:49 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:05:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:49 devstack sudo[89168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.info Jul 06 21:05:49 devstack sudo[89168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:50 devstack sudo[89168]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.info" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.111s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:05:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d81bd7ae-a560-471d-8e10-904861ebd2a4 tempest-GroupSnapshotsTest-1713079612 None] group_snapshot e8cebbd8-8e35-41ef-90da-a2c3ee055c15: created successfully Jul 06 21:05:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] group_snapshot e8cebbd8-8e35-41ef-90da-a2c3ee055c15: deleting Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] group_snapshot e8cebbd8-8e35-41ef-90da-a2c3ee055c15: deleting {{(pid=87273) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-71fb8d39-63e0-4740-9c75-92d5a44969f2" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-71fb8d39-63e0-4740-9c75-92d5a44969f2" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-bd102dce-6e1c-4121-b538-a3a67e081a1c" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-bd102dce-6e1c-4121-b538-a3a67e081a1c" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Deleting offline snapshot bd102dce-6e1c-4121-b538-a3a67e081a1c of volume 71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] snapshot_file for this snap is: volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0324c001-b69f-45d7-85a9-f09314f0bf34]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:51 devstack sudo[89171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c Jul 06 21:05:51 devstack sudo[89171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:52 devstack sudo[89171]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c" returned: 0 in 1.135s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-71fb8d39-63e0-4740-9c75-92d5a44969f2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:05:52 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb84c49f-a57e-4bd9-91ef-0dea784ec199]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:52 devstack sudo[89177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 Jul 06 21:05:52 devstack sudo[89177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:53 devstack sudo[89177]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2" returned: 0 in 1.208s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:53 devstack sudo[89183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c Jul 06 21:05:53 devstack sudo[89183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:54 devstack sudo[89183]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c" returned: 0 in 0.962s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:54 devstack sudo[89189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c Jul 06 21:05:54 devstack sudo[89189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:55 devstack sudo[89189]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2.bd102dce-6e1c-4121-b538-a3a67e081a1c" returned: 0 in 0.887s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-bd102dce-6e1c-4121-b538-a3a67e081a1c" released by "_delete_snapshot" :: held 4.353s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-71fb8d39-63e0-4740-9c75-92d5a44969f2" released by "delete_snapshot" :: held 4.383s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-5c052218-c1b3-48ad-b265-7327ddc71a6f" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5c052218-c1b3-48ad-b265-7327ddc71a6f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-f37d85d4-37ef-4ee4-a776-314b8e81037b" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-f37d85d4-37ef-4ee4-a776-314b8e81037b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Deleting offline snapshot f37d85d4-37ef-4ee4-a776-314b8e81037b of volume 5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] snapshot_file for this snap is: volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a832cfed-b44f-41f2-a4b2-9a31d7075cfd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:56 devstack sudo[89199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b Jul 06 21:05:56 devstack sudo[89199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:56 devstack sudo[89199]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b" returned: 0 in 0.912s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5c052218-c1b3-48ad-b265-7327ddc71a6f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:05:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[52256027-3d67-4ec8-a90d-34971cf1e5b9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:05:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:57 devstack sudo[89204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f Jul 06 21:05:57 devstack sudo[89204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:57 devstack sudo[89204]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f" returned: 0 in 0.978s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:57 devstack sudo[89210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b Jul 06 21:05:57 devstack sudo[89210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:58 devstack sudo[89210]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b" returned: 0 in 0.878s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:05:58 devstack sudo[89220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b Jul 06 21:05:58 devstack sudo[89220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:05:59 devstack sudo[89220]: pam_unix(sudo:session): session closed for user root Jul 06 21:05:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f.f37d85d4-37ef-4ee4-a776-314b8e81037b" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:05:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-f37d85d4-37ef-4ee4-a776-314b8e81037b" released by "_delete_snapshot" :: held 3.621s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5c052218-c1b3-48ad-b265-7327ddc71a6f" released by "delete_snapshot" :: held 3.655s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:05:59 devstack cinder-volume[87273]: WARNING cinder.quota [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1180171789 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1180171789, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:05:59 devstack cinder-volume[87273]: WARNING cinder.quota [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1180171789 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1180171789, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:05:59 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['de405f41-2b2d-4016-9e07-8e35348ae23c', 'e8696731-7a16-436e-ba1d-9b8bef08d3dd', 'db509843-3b2f-435a-b47e-18e2e8c45367', 'd72dfac6-9f6a-4309-9875-80bc08b9410b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:59 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['58c7dea8-3682-4cbd-bf1b-769a0a3abed4', 'd1f4d993-f8a3-4437-9e8a-ee44470d44fe', 'fecd2ec9-ebb5-4b8f-9722-3a063fb2a441', '7da1647c-2a62-4ce8-bfd0-eeda3e71ea03'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:05:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-93d601f7-25ad-461c-8d18-f194533b5d37 tempest-GroupSnapshotsTest-1713079612 None] group_snapshot e8cebbd8-8e35-41ef-90da-a2c3ee055c15: deleted successfully Jul 06 21:06:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-980b6b09-b176-4cd2-9396-13d82d2545b2 tempest-GroupsV314Test-1384768525 None] Group tempest-GroupsV314Test-Group-1569335869: creating Jul 06 21:06:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-980b6b09-b176-4cd2-9396-13d82d2545b2 tempest-GroupsV314Test-1384768525 None] Group tempest-GroupsV314Test-Group-1569335869: created successfully Jul 06 21:06:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-980b6b09-b176-4cd2-9396-13d82d2545b2 tempest-GroupsV314Test-1384768525 None] Create group completed successfully. Jul 06 21:06:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-5c052218-c1b3-48ad-b265-7327ddc71a6f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5c052218-c1b3-48ad-b265-7327ddc71a6f" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[317039e0-ffa3-4bdf-a504-b462e29794b7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:00 devstack sudo[89223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f Jul 06 21:06:00 devstack sudo[89223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:01 devstack sudo[89227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:06:01 devstack sudo[89227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:01 devstack sudo[89223]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f" returned: 0 in 1.040s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:01 devstack sudo[89232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f Jul 06 21:06:01 devstack sudo[89232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:02 devstack sudo[89227]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.093s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Flow 'volume_create_manager' (4fea2e2c-e83d-455c-8992-ebacdf4b4f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86e66aa-dbb4-40e5-b8fd-df6d4779aa4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f86e66aa-dbb4-40e5-b8fd-df6d4779aa4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-188157463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7533d169-cee7-4631-bed1-761a7c7a1f97,host='devstack@QuobyteHD#QuobyteHD',id=ef704141-7c03-4357-9dd0-eed2a6e44220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a645ea57c094c069ee799cec18cd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:02Z,use_quota=True,user_id='ff335fa8693f4c05a5abdf592ee251e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de5003d1-88bb-456e-bf6e-986a3541df88),volume_type_id=de5003d1-88bb-456e-bf6e-986a3541df88)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbaaeeb-2889-449e-b9f2-070c62a4864f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcbaaeeb-2889-449e-b9f2-070c62a4864f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e83a9de-c056-4af9-b184-9a50b91c6bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e83a9de-c056-4af9-b184-9a50b91c6bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef704141-7c03-4357-9dd0-eed2a6e44220', 'volume_name': 'volume-ef704141-7c03-4357-9dd0-eed2a6e44220', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddff4e6-3174-4067-8469-732f62d7815e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ddff4e6-3174-4067-8469-732f62d7815e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477531ad-b1e5-4689-a250-0c72e2aac6e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Volume ef704141-7c03-4357-9dd0-eed2a6e44220: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef704141-7c03-4357-9dd0-eed2a6e44220', 'volume_size': 1} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7533d169-cee7-4631-bed1-761a7c7a1f97,created_at=2026-07-06T19:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-188157463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7533d169-cee7-4631-bed1-761a7c7a1f97,host='devstack@QuobyteHD#QuobyteHD',id=ef704141-7c03-4357-9dd0-eed2a6e44220,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a645ea57c094c069ee799cec18cd987',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:02Z,use_quota=True,user_id='ff335fa8693f4c05a5abdf592ee251e2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(de5003d1-88bb-456e-bf6e-986a3541df88),volume_type_id=de5003d1-88bb-456e-bf6e-986a3541df88)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Creating volume ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:06:02 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:02 devstack sudo[89235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 1073741824 Jul 06 21:06:02 devstack sudo[89235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:02 devstack sudo[89232]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5c052218-c1b3-48ad-b265-7327ddc71a6f" returned: 0 in 1.108s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-5c052218-c1b3-48ad-b265-7327ddc71a6f" released by "delete_volume" :: held 2.225s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-71fb8d39-63e0-4740-9c75-92d5a44969f2" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-71fb8d39-63e0-4740-9c75-92d5a44969f2" acquired by "delete_volume" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e6dd282-972a-4250-9b5c-2e26cc86ddf4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:03 devstack sudo[89238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 Jul 06 21:06:03 devstack sudo[89238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Flow 'volume_create_manager' (b13bc4bb-c33c-4f0b-af43-f4abebff0da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76c99cd-119f-40a7-b63a-2e1525f1ca13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b76c99cd-119f-40a7-b63a-2e1525f1ca13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-441910825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8747152a-91e9-4eda-9222-ceb8e49e3f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687ae7e6db764cd18e67c80274599cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:03Z,use_quota=True,user_id='7789a7960cb6476b8b9a0bf96a7bb0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c348b6cc-e6ec-43c1-83a6-9be30c7e7e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c348b6cc-e6ec-43c1-83a6-9be30c7e7e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f341e3f-8837-40f8-85e9-8a39f62a74e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f341e3f-8837-40f8-85e9-8a39f62a74e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8747152a-91e9-4eda-9222-ceb8e49e3f61', 'volume_name': 'volume-8747152a-91e9-4eda-9222-ceb8e49e3f61', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b0fe1c-8c55-4314-b09c-429176681497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2b0fe1c-8c55-4314-b09c-429176681497) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f2a100-f651-468e-a018-e45b983343ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Volume 8747152a-91e9-4eda-9222-ceb8e49e3f61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8747152a-91e9-4eda-9222-ceb8e49e3f61', 'volume_size': 1} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:03 devstack sudo[89235]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 1073741824" returned: 0 in 1.308s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:03 devstack sudo[89245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 Jul 06 21:06:03 devstack sudo[89245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:04 devstack sudo[89238]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2" returned: 0 in 1.309s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:04 devstack sudo[89250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2 Jul 06 21:06:04 devstack sudo[89250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:04 devstack sudo[89245]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220" returned: 0 in 0.842s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] <== create_volume: return (2208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.213s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.344s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-441910825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8747152a-91e9-4eda-9222-ceb8e49e3f61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='687ae7e6db764cd18e67c80274599cd1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:03Z,use_quota=True,user_id='7789a7960cb6476b8b9a0bf96a7bb0b6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Creating volume 8747152a-91e9-4eda-9222-ceb8e49e3f61 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:06:04 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:04 devstack sudo[89253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 1073741824 Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (477531ad-b1e5-4689-a250-0c72e2aac6e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef704141-7c03-4357-9dd0-eed2a6e44220', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:04 devstack sudo[89253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b112c57-ad48-4010-b96b-f25976079850) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Volume volume-ef704141-7c03-4357-9dd0-eed2a6e44220 (ef704141-7c03-4357-9dd0-eed2a6e44220): created successfully Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b112c57-ad48-4010-b96b-f25976079850) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Flow 'volume_create_manager' (4fea2e2c-e83d-455c-8992-ebacdf4b4f4e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:04 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-11d35c77-5759-423f-9ad9-c6f8772eabe7 tempest-GroupsV314Test-1384768525 None] Created volume successfully. Jul 06 21:06:05 devstack sudo[89250]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71fb8d39-63e0-4740-9c75-92d5a44969f2" returned: 0 in 0.894s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-71fb8d39-63e0-4740-9c75-92d5a44969f2" released by "delete_volume" :: held 2.297s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['19d61d8a-a2f5-4874-ae53-191765c97d50'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:05 devstack cinder-volume[87273]: WARNING cinder.quota [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1180171789 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1180171789, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['790ec5cd-206a-40c9-89a3-7e88e7de6248', 'f71fbaee-fd58-40b4-8b51-a2e99ab6fd93', '9202670b-1fc6-4d2a-8bed-225fc677c05b', '88edd66a-b1df-4d91-8a53-f3a541ce30fa'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['f2ff0801-518e-466e-ab6d-a0ae9f6aeb05', '51a59b90-df3a-49fb-b967-dd7d3dc2b000', '434b8c91-f550-480c-96ec-f741e07ffb73', '42a07fe0-a27a-4d8f-b38d-b7df56a0c8ed'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:05 devstack sudo[89263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:06:05 devstack sudo[89263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:05 devstack sudo[89253]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 1073741824" returned: 0 in 1.265s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:06 devstack sudo[89265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 Jul 06 21:06:06 devstack sudo[89265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:06 devstack sudo[89263]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.917s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:06 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:06:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-fcc90f6d-2196-45b6-9756-03ce5bb25d42 tempest-GroupSnapshotsTest-1713079612 None] Delete group completed successfully. Jul 06 21:06:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c25e2054-7d9a-4cb3-ac82-85bed67a68bc tempest-GroupSnapshotsTest-1713079612 None] Group tempest-GroupSnapshotsTest-Group-266165526: creating Jul 06 21:06:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c25e2054-7d9a-4cb3-ac82-85bed67a68bc tempest-GroupSnapshotsTest-1713079612 None] Group tempest-GroupSnapshotsTest-Group-266165526: created successfully Jul 06 21:06:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c25e2054-7d9a-4cb3-ac82-85bed67a68bc tempest-GroupSnapshotsTest-1713079612 None] Create group completed successfully. Jul 06 21:06:07 devstack sudo[89265]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61" returned: 0 in 0.967s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] <== create_volume: return (2331ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.338s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.220s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:07 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Cloning volume ef704141-7c03-4357-9dd0-eed2a6e44220 to volume bc8eb592-9d45-4833-b5be-a8c0a8129941 Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57f2a100-f651-468e-a018-e45b983343ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8747152a-91e9-4eda-9222-ceb8e49e3f61', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510191fc-6b99-4b1b-909c-459545170408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Volume volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 (8747152a-91e9-4eda-9222-ceb8e49e3f61): created successfully Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (510191fc-6b99-4b1b-909c-459545170408) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Flow 'volume_create_manager' (b13bc4bb-c33c-4f0b-af43-f4abebff0da4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a20af580-2e5b-48c4-9576-3e8549644b51 tempest-ServerActionsTestOtherA-99214274 None] Created volume successfully. Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Creating offline snapshot b469fa8c-9e07-4dd7-a80e-e1ce42546189 of volume ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[41c1af56-d118-4e77-842b-5492f87c64ee]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:07 devstack sudo[89269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 Jul 06 21:06:07 devstack sudo[89269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:08 devstack sudo[89269]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220" returned: 0 in 0.835s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:08 devstack sudo[89275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 1G Jul 06 21:06:08 devstack sudo[89275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (62c6acde-7c4e-4705-817a-89c213994e85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce8f5f6-9f3b-4f18-a0b8-f691463a1cf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ce8f5f6-9f3b-4f18-a0b8-f691463a1cf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-303495218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b41ed021-65ed-4bd6-a759-201d46c4b690,host='devstack@QuobyteHD#QuobyteHD',id=6149f005-39c7-44b5-9b14-846453286d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:09Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff0b6afe-4110-412b-8c7f-76b9d3fc2116),volume_type_id=ff0b6afe-4110-412b-8c7f-76b9d3fc2116)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e170a8c-c707-480c-bddc-3cd3581b90b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9e170a8c-c707-480c-bddc-3cd3581b90b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8b1dcd-b14f-416a-b479-a128e301c690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb8b1dcd-b14f-416a-b479-a128e301c690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6149f005-39c7-44b5-9b14-846453286d3c', 'volume_name': 'volume-6149f005-39c7-44b5-9b14-846453286d3c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f26797-b19a-43e6-8e0f-7e7bf5b8ea77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (63f26797-b19a-43e6-8e0f-7e7bf5b8ea77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f7696f-24e6-4bfc-9373-25df101c9d3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:08 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Volume 6149f005-39c7-44b5-9b14-846453286d3c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6149f005-39c7-44b5-9b14-846453286d3c', 'volume_size': 1} Jul 06 21:06:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:09 devstack sudo[89275]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 1G" returned: 0 in 1.122s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef704141-7c03-4357-9dd0-eed2a6e44220 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:09 devstack sudo[89284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef704141-7c03-4357-9dd0-eed2a6e44220 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 Jul 06 21:06:09 devstack sudo[89284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Flow 'volume_create_manager' (cea91dd6-0b1f-42ff-ad4e-943edd28912b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad9a6b8-77f9-4830-a5db-efe385013b7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ad9a6b8-77f9-4830-a5db-efe385013b7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-328796583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8b9284-1ef3-46e9-bdb8-772116693e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccdb1fa69a043429f9e9177c427c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:10Z,use_quota=True,user_id='52fd780db11e40a49878b913444a4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e536575-13cd-469d-9a37-d9a3448451be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e536575-13cd-469d-9a37-d9a3448451be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028ab62a-5e3f-4aa4-b28b-c9257928c3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (028ab62a-5e3f-4aa4-b28b-c9257928c3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8a8b9284-1ef3-46e9-bdb8-772116693e1a', 'volume_name': 'volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b5a0ab-4278-4a32-9003-6f99dfd5bee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0b5a0ab-4278-4a32-9003-6f99dfd5bee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3798a5-6977-441d-bfd5-8db76631bc38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:09 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Volume 8a8b9284-1ef3-46e9-bdb8-772116693e1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a', 'volume_size': 1} Jul 06 21:06:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:09 devstack sudo[89284]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ef704141-7c03-4357-9dd0-eed2a6e44220 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189" returned: 0 in 0.862s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:10 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:06:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:10 devstack sudo[89294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 Jul 06 21:06:10 devstack sudo[89294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:10 devstack sudo[89294]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189" returned: 0 in 0.692s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:10 devstack sudo[89297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.info Jul 06 21:06:10 devstack sudo[89297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:11 devstack sudo[89297]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.info" returned: 0 in 0.716s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:11 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:06:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:11 devstack sudo[89300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.info Jul 06 21:06:11 devstack sudo[89300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:12 devstack sudo[89300]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.info" returned: 0 in 0.649s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Acquiring lock "cinder-quobyte-bc8eb592-9d45-4833-b5be-a8c0a8129941" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-bc8eb592-9d45-4833-b5be-a8c0a8129941" acquired by "_copy_volume_from_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] snapshot: b469fa8c-9e07-4dd7-a80e-e1ce42546189, volume: bc8eb592-9d45-4833-b5be-a8c0a8129941, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f2ae33-7f34-409d-a61f-fd9e316be415]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:12 devstack sudo[89303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 Jul 06 21:06:12 devstack sudo[89303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:12 devstack sudo[89303]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189" returned: 0 in 0.786s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef704141-7c03-4357-9dd0-eed2a6e44220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9758fbbf-f098-4488-ac07-bfee34264bae]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:13 devstack sudo[89308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 Jul 06 21:06:13 devstack sudo[89308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:13 devstack sudo[89308]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220" returned: 0 in 0.811s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:13 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:06:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:13 devstack sudo[89314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 Jul 06 21:06:13 devstack sudo[89314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:19 devstack sudo[89314]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941" returned: 0 in 5.497s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:19 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef01f7-c5e4-42fd-be6b-fcdcb1a43fa9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:19 devstack sudo[89348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 Jul 06 21:06:19 devstack sudo[89348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:20 devstack sudo[89348]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220" returned: 0 in 0.898s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:20 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220, size 1024.00 MB, duration 5.50 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:06:20 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Converted 1024.00 MB image at 186.25 MB/s Jul 06 21:06:20 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:06:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:20 devstack sudo[89353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 Jul 06 21:06:20 devstack sudo[89353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:20 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=82,cinder:SELECT=69,cinder:INSERT=21,cinder:DELETE=3 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:06:20 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:DELETE=6,cinder:UPDATE=80,cinder:SELECT=82,cinder:INSERT=17 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:06:21 devstack sudo[89353]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941" returned: 0 in 0.827s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-bc8eb592-9d45-4833-b5be-a8c0a8129941" released by "_copy_volume_from_snapshot" :: held 8.911s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Acquiring lock "cinder-quobyte-b469fa8c-9e07-4dd7-a80e-e1ce42546189" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-b469fa8c-9e07-4dd7-a80e-e1ce42546189" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Deleting offline snapshot b469fa8c-9e07-4dd7-a80e-e1ce42546189 of volume ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] snapshot_file for this snap is: volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c90679a-3b04-4c30-ad15-e73e5891b2a8]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:21 devstack sudo[89378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 Jul 06 21:06:21 devstack sudo[89378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:21 devstack sudo[89378]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189" returned: 0 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ef704141-7c03-4357-9dd0-eed2a6e44220(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fce83bf-68cb-41b0-a98f-c9fd251081e9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:21 devstack sudo[89384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 Jul 06 21:06:21 devstack sudo[89384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:22 devstack sudo[89384]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220" returned: 0 in 0.758s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:22 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 Jul 06 21:06:22 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:23 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189" returned: 0 in 0.719s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:23 devstack sudo[89417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189 Jul 06 21:06:23 devstack sudo[89417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:24 devstack sudo[89417]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220.b469fa8c-9e07-4dd7-a80e-e1ce42546189" returned: 0 in 0.653s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-b469fa8c-9e07-4dd7-a80e-e1ce42546189" released by "_delete_snapshot" :: held 2.982s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 17.077s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.280s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b41ed021-65ed-4bd6-a759-201d46c4b690,created_at=2026-07-06T19:06:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-303495218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b41ed021-65ed-4bd6-a759-201d46c4b690,host='devstack@QuobyteHD#QuobyteHD',id=6149f005-39c7-44b5-9b14-846453286d3c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='01a3733e40184f1db2b476efb7c7a96a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:09Z,use_quota=True,user_id='e3c34fa05ffe4a1cae1238c9d809536f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ff0b6afe-4110-412b-8c7f-76b9d3fc2116),volume_type_id=ff0b6afe-4110-412b-8c7f-76b9d3fc2116)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Creating volume 6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:06:24 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:06:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:24 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c 1073741824 Jul 06 21:06:24 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-db0debc8-4fa2-4445-9aab-bdd1223840d2 tempest-GroupsV314Test-1384768525 None] Create group from source-group-7533d169-cee7-4631-bed1-761a7c7a1f97 completed successfully. Jul 06 21:06:25 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c 1073741824" returned: 0 in 0.954s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:25 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c Jul 06 21:06:25 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:25 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c" returned: 0 in 0.795s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] <== create_volume: return (1802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 16.142s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-328796583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8a8b9284-1ef3-46e9-bdb8-772116693e1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ccdb1fa69a043429f9e9177c427c119',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:10Z,use_quota=True,user_id='52fd780db11e40a49878b913444a4f60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Creating volume 8a8b9284-1ef3-46e9-bdb8-772116693e1a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:06:25 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:06:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:25 devstack sudo[89429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a 1073741824 Jul 06 21:06:25 devstack sudo[89429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0f7696f-24e6-4bfc-9373-25df101c9d3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6149f005-39c7-44b5-9b14-846453286d3c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40714edb-a266-4329-bce7-038d4741b6a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:26 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Volume volume-6149f005-39c7-44b5-9b14-846453286d3c (6149f005-39c7-44b5-9b14-846453286d3c): created successfully Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40714edb-a266-4329-bce7-038d4741b6a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Flow 'volume_create_manager' (62c6acde-7c4e-4705-817a-89c213994e85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Acquiring lock "cinder-quobyte-bc8eb592-9d45-4833-b5be-a8c0a8129941" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b465a8d2-e221-434d-a970-626e5cf10f18 tempest-GroupSnapshotsTest-1713079612 None] Created volume successfully. Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-bc8eb592-9d45-4833-b5be-a8c0a8129941" acquired by "delete_volume" :: waited 0.037s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[998a633f-ecda-4ffa-9d4e-6a555ae4700e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:26 devstack sudo[89431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 Jul 06 21:06:26 devstack sudo[89431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:27 devstack sudo[89429]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a 1073741824" returned: 0 in 1.133s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:27 devstack sudo[89441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a Jul 06 21:06:27 devstack sudo[89441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] GroupSnapshot ea3e13f9-8d0a-4f6b-995c-1eeaba13933a: creating. Jul 06 21:06:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Group snapshot ea3e13f9-8d0a-4f6b-995c-1eeaba13933a: creating. {{(pid=87273) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 21:06:27 devstack sudo[89431]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941" returned: 0 in 1.151s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:27 devstack sudo[89443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941 Jul 06 21:06:27 devstack sudo[89443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:27 devstack sudo[89441]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a" returned: 0 in 0.881s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] <== create_volume: return (2084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.091s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.645s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3798a5-6977-441d-bfd5-8db76631bc38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4664c73c-c10e-48b9-9922-62878272dd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Creating offline snapshot 93e4a5db-6814-4dcb-8de8-332402686a69 of volume 6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:06:28 devstack sudo[89443]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-bc8eb592-9d45-4833-b5be-a8c0a8129941" returned: 0 in 0.701s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Volume volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a (8a8b9284-1ef3-46e9-bdb8-772116693e1a): created successfully Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4664c73c-c10e-48b9-9922-62878272dd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Flow 'volume_create_manager' (cea91dd6-0b1f-42ff-ad4e-943edd28912b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-bc8eb592-9d45-4833-b5be-a8c0a8129941" released by "delete_volume" :: held 1.946s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b48ae5a-7c5c-4199-bbf9-2f121e049eb9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bc68c9e3-e4e4-4204-9210-b1e694f51e43 tempest-TaggedAttachmentsTest-114923880 None] Created volume successfully. Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Created reservations ['796afc1e-b46e-4285-bf27-09ed181c1945'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:28 devstack cinder-volume[87273]: WARNING cinder.quota [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1216411139 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1216411139, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:06:28 devstack cinder-volume[87273]: WARNING cinder.quota [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1216411139 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1216411139, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Created reservations ['27f28e31-3e0b-410e-950c-21eb80e8cc06', '7479ce85-2d88-461a-8be3-e0371530355e', '1694eda7-7efc-4592-9be3-a99ad37f735e', '1768b902-735e-410b-9aae-bedd75d790ea'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:28 devstack sudo[89450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c Jul 06 21:06:28 devstack sudo[89450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:28 devstack sudo[89452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:06:28 devstack sudo[89452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Acquiring lock "cinder-quobyte-ef704141-7c03-4357-9dd0-eed2a6e44220" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-ef704141-7c03-4357-9dd0-eed2a6e44220" acquired by "delete_volume" :: waited 0.045s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5829fe0-c50e-4360-820e-572a857d70e1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:29 devstack sudo[89450]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c" returned: 0 in 1.493s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:29 devstack sudo[89457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 Jul 06 21:06:29 devstack sudo[89457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:29 devstack sudo[89458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 1G Jul 06 21:06:29 devstack sudo[89458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:29 devstack sudo[89452]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.469s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:29 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:06:29 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-946c5fc8-72bb-4621-8576-8ccefbf7e239 tempest-GroupsV314Test-1384768525 None] Delete group completed successfully. Jul 06 21:06:30 devstack sudo[89458]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 1G" returned: 0 in 1.017s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6149f005-39c7-44b5-9b14-846453286d3c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:30 devstack sudo[89473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6149f005-39c7-44b5-9b14-846453286d3c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 Jul 06 21:06:30 devstack sudo[89473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:30 devstack sudo[89457]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220" returned: 0 in 1.406s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:30 devstack sudo[89475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220 Jul 06 21:06:30 devstack sudo[89475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:31 devstack sudo[89473]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6149f005-39c7-44b5-9b14-846453286d3c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69" returned: 0 in 0.876s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:31 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:31 devstack sudo[89481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 Jul 06 21:06:31 devstack sudo[89481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:31 devstack sudo[89475]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ef704141-7c03-4357-9dd0-eed2a6e44220" returned: 0 in 0.802s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Lock "cinder-quobyte-ef704141-7c03-4357-9dd0-eed2a6e44220" released by "delete_volume" :: held 2.328s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Created reservations ['1d8a81ab-1419-43d6-84be-e2517d767aca'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Created reservations ['e2baf182-4878-481e-a34e-7f94b2179545', '1da1acd9-6d08-4dc9-ab1e-7172740e3529', 'f81cd9b2-753e-4d95-98b9-0f06e925f779', 'cadd82c6-f857-4b3a-b6dd-0ace6cf72a44'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:31 devstack sudo[89483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:06:31 devstack sudo[89483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:32 devstack sudo[89481]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69" returned: 0 in 1.266s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:32 devstack sudo[89486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.info Jul 06 21:06:32 devstack sudo[89486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:33 devstack sudo[89483]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.342s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:33 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:06:33 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0d379362-33b0-4e9f-a1f4-0dc08bab0dd2 tempest-GroupsV314Test-1384768525 None] Delete group completed successfully. Jul 06 21:06:33 devstack sudo[89486]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.info" returned: 0 in 1.011s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:33 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:06:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:33 devstack sudo[89494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.info Jul 06 21:06:33 devstack sudo[89494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:34 devstack sudo[89494]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.info" returned: 0 in 0.799s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.654s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-53756ecb-f2a7-4e5d-be90-c031045e2514 tempest-GroupSnapshotsTest-1713079612 None] group_snapshot ea3e13f9-8d0a-4f6b-995c-1eeaba13933a: created successfully Jul 06 21:06:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] group_snapshot ea3e13f9-8d0a-4f6b-995c-1eeaba13933a: deleting Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] group_snapshot ea3e13f9-8d0a-4f6b-995c-1eeaba13933a: deleting {{(pid=87273) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-6149f005-39c7-44b5-9b14-846453286d3c" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-6149f005-39c7-44b5-9b14-846453286d3c" acquired by "delete_snapshot" :: waited 0.043s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-93e4a5db-6814-4dcb-8de8-332402686a69" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-93e4a5db-6814-4dcb-8de8-332402686a69" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Deleting offline snapshot 93e4a5db-6814-4dcb-8de8-332402686a69 of volume 6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] snapshot_file for this snap is: volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbf56e9f-49f3-4a06-891c-c7c51783878a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:35 devstack sudo[89521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 Jul 06 21:06:35 devstack sudo[89521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:36 devstack sudo[89521]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69" returned: 0 in 0.956s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6149f005-39c7-44b5-9b14-846453286d3c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:06:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[554b1d75-c7be-40b9-88b6-02bdb3252eed]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:36 devstack sudo[89527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c Jul 06 21:06:36 devstack sudo[89527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:37 devstack sudo[89527]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c" returned: 0 in 0.779s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:37 devstack sudo[89533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 Jul 06 21:06:37 devstack sudo[89533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:37 devstack sudo[89533]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69" returned: 0 in 0.792s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:37 devstack sudo[89540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69 Jul 06 21:06:37 devstack sudo[89540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:38 devstack sudo[89540]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c.93e4a5db-6814-4dcb-8de8-332402686a69" returned: 0 in 0.653s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-93e4a5db-6814-4dcb-8de8-332402686a69" released by "_delete_snapshot" :: held 3.336s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-6149f005-39c7-44b5-9b14-846453286d3c" released by "delete_snapshot" :: held 3.370s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:38 devstack cinder-volume[87273]: WARNING cinder.quota [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-901451771 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-901451771, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:06:38 devstack cinder-volume[87273]: WARNING cinder.quota [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-901451771 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-901451771, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:06:38 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['6aa13c90-bf15-4c87-88b0-f827fc801896', '86cb8c12-877d-415b-8c0b-ef3a3627b499', 'a0a2d4fe-0135-4706-aa35-a32a699453c6', 'f71f68ca-0c14-478d-9555-c7724e21f30e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-454773d9-c20a-4094-817a-a296fe27009e tempest-GroupSnapshotsTest-1713079612 None] group_snapshot ea3e13f9-8d0a-4f6b-995c-1eeaba13933a: deleted successfully Jul 06 21:06:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bdc87be5-80e4-46e4-b9bc-9aee6dc67944 tempest-GroupsV320Test-465970755 None] Group tempest-GroupsV320Test-Group-1553748269: creating Jul 06 21:06:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bdc87be5-80e4-46e4-b9bc-9aee6dc67944 tempest-GroupsV320Test-465970755 None] Group tempest-GroupsV320Test-Group-1553748269: created successfully Jul 06 21:06:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bdc87be5-80e4-46e4-b9bc-9aee6dc67944 tempest-GroupsV320Test-465970755 None] Create group completed successfully. Jul 06 21:06:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "cinder-quobyte-6149f005-39c7-44b5-9b14-846453286d3c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:06:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-6149f005-39c7-44b5-9b14-846453286d3c" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:06:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d4deb7-bb73-44e2-91d0-420811d27843]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:40 devstack sudo[89581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c Jul 06 21:06:40 devstack sudo[89581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Created reservations ['fc060445-ee04-4392-af71-4b380ff98217'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:41 devstack sudo[89614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:06:41 devstack sudo[89614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:41 devstack sudo[89581]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c" returned: 0 in 1.373s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:41 devstack sudo[89622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c Jul 06 21:06:41 devstack sudo[89622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:42 devstack sudo[89614]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:06:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-635ef249-3515-4107-9b8b-a54a714eb84e tempest-GroupsV320Test-465970755 None] Delete group completed successfully. Jul 06 21:06:42 devstack sudo[89622]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6149f005-39c7-44b5-9b14-846453286d3c" returned: 0 in 0.761s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Lock "cinder-quobyte-6149f005-39c7-44b5-9b14-846453286d3c" released by "delete_volume" :: held 2.215s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['813dac32-f3c2-46c1-8769-68c7ee1ef959'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:42 devstack cinder-volume[87273]: WARNING cinder.quota [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-901451771 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-901451771, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Created reservations ['cf2cfc6d-2e3c-4a1e-b71d-f105065b9b98', '53a114bc-fa6b-41a3-9734-557586321702', '5f0c1ce0-aef2-4301-9f79-818dc82bb60f', '74fbed3f-094f-4d66-b8df-9c837ae4648f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:42 devstack sudo[89629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:06:42 devstack sudo[89629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:43 devstack sudo[89629]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.804s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:43 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:06:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4952ec0d-044c-41e3-ab69-bf9bc1c867a2 tempest-GroupSnapshotsTest-1713079612 None] Delete group completed successfully. Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Flow 'volume_create_manager' (adc627d1-e944-4160-9e69-f8c11e33f914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7549aa-495b-4819-bcc8-900116bfc114) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c7549aa-495b-4819-bcc8-900116bfc114) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-914325904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65e89791f7847828f385b459f83d312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:49Z,use_quota=True,user_id='d8175a20a55c40bab206723b95bd085a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713ac88b-4b89-49c1-960a-06673bf8eb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (713ac88b-4b89-49c1-960a-06673bf8eb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bd4a31-a7b7-4d6b-b21a-1d316760c06b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c7bd4a31-a7b7-4d6b-b21a-1d316760c06b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3b2dbab-ba9e-4e9e-891e-fe3ca296f31d', 'volume_name': 'volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f043ed-a649-4c94-abb4-17557d65a22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0f043ed-a649-4c94-abb4-17557d65a22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f69421b-5d22-4b4c-9a38-a3f458048c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d', 'volume_size': 1} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-914325904',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c65e89791f7847828f385b459f83d312',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:06:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:06:49Z,use_quota=True,user_id='d8175a20a55c40bab206723b95bd085a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Creating volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:06:49 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:06:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:49 devstack sudo[89712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d 1073741824 Jul 06 21:06:49 devstack sudo[89712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:50 devstack sudo[89712]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d 1073741824" returned: 0 in 1.302s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:50 devstack sudo[89720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d Jul 06 21:06:50 devstack sudo[89720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-01dd709b-69a2-4868-a59f-86d4295a4f55 req-642cd228-df51-4443-a934-ddc9c8d97dc3 tempest-ServerActionsTestOtherA-99214274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:51 devstack sudo[89720]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" returned: 0 in 0.958s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] <== create_volume: return (2355ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.358s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-01dd709b-69a2-4868-a59f-86d4295a4f55 req-642cd228-df51-4443-a934-ddc9c8d97dc3 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.128s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f69421b-5d22-4b4c-9a38-a3f458048c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2b79e8-ae4f-4329-aa14-6691e3e19516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[03858b38-a095-4339-bb64-25548544b668]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-01dd709b-69a2-4868-a59f-86d4295a4f55 req-642cd228-df51-4443-a934-ddc9c8d97dc3 tempest-ServerActionsTestOtherA-99214274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:51 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Volume volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d (d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d): created successfully Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a2b79e8-ae4f-4329-aa14-6691e3e19516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:06:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Flow 'volume_create_manager' (adc627d1-e944-4160-9e69-f8c11e33f914) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:06:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1e3528b4-e013-42bf-8f3b-c49f27e723b8 tempest-SnapshotsActionsTest-1963226023 None] Created volume successfully. Jul 06 21:06:52 devstack sudo[89733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 Jul 06 21:06:52 devstack sudo[89733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:53 devstack sudo[89733]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-01dd709b-69a2-4868-a59f-86d4295a4f55 req-642cd228-df51-4443-a934-ddc9c8d97dc3 tempest-ServerActionsTestOtherA-99214274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61" returned: 0 in 1.194s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-01dd709b-69a2-4868-a59f-86d4295a4f55 req-642cd228-df51-4443-a934-ddc9c8d97dc3 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.233s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.108s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Creating offline snapshot ae2b160b-18e9-43ba-b138-eb561cbf6bf7 of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:06:53 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8999b4c-8672-4515-9bbd-8a36df0ee21d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-01dd709b-69a2-4868-a59f-86d4295a4f55 req-642cd228-df51-4443-a934-ddc9c8d97dc3 tempest-ServerActionsTestOtherA-99214274 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-8747152a-91e9-4eda-9222-ceb8e49e3f61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a50feb00-ae9c-4e66-8d69-6b738f3bcf37', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:06:53 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-01dd709b-69a2-4868-a59f-86d4295a4f55 req-642cd228-df51-4443-a934-ddc9c8d97dc3 tempest-ServerActionsTestOtherA-99214274 None] attachment_update completed successfully. Jul 06 21:06:53 devstack sudo[89739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d Jul 06 21:06:53 devstack sudo[89739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:54 devstack sudo[89739]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" returned: 0 in 0.994s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:54 devstack sudo[89811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 1G Jul 06 21:06:54 devstack sudo[89811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:55 devstack sudo[89811]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 1G" returned: 0 in 0.928s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:55 devstack sudo[90136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:06:55 devstack sudo[90136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:55 devstack sudo[90136]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.695s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:55 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 is being set with open permissions: ugo+rw Jul 06 21:06:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:55 devstack sudo[90144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:06:55 devstack sudo[90144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:56 devstack sudo[90144]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:56 devstack sudo[90148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.info Jul 06 21:06:56 devstack sudo[90148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-cb8cb4cd-c6a9-40cb-91f4-226f398d3f11 tempest-GroupsTest-823545862 None] Group tempest-Group1-1387469901: creating Jul 06 21:06:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-cb8cb4cd-c6a9-40cb-91f4-226f398d3f11 tempest-GroupsTest-823545862 None] Group tempest-Group1-1387469901: created successfully Jul 06 21:06:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-cb8cb4cd-c6a9-40cb-91f4-226f398d3f11 tempest-GroupsTest-823545862 None] Create group completed successfully. Jul 06 21:06:57 devstack sudo[90148]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.info" returned: 0 in 0.648s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:57 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.info is being set with open permissions: ugo+rw Jul 06 21:06:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:57 devstack sudo[90151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.info Jul 06 21:06:57 devstack sudo[90151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:57 devstack sudo[90151]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.info" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.827s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:06:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-aef8823e-d073-49bf-be1d-2a191775886a tempest-SnapshotsActionsTest-1963226023 None] Create snapshot completed successfully Jul 06 21:06:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-36ef5df1-d912-4467-bfce-c20684224a2e tempest-GroupsTest-823545862 None] Group tempest-Group2-1627554512: creating Jul 06 21:06:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-36ef5df1-d912-4467-bfce-c20684224a2e tempest-GroupsTest-823545862 None] Group tempest-Group2-1627554512: created successfully Jul 06 21:06:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-36ef5df1-d912-4467-bfce-c20684224a2e tempest-GroupsTest-823545862 None] Create group completed successfully. Jul 06 21:06:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:06:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:06:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Creating offline snapshot 99c92924-f67c-42b4-b1b6-8d14e1fc5a6c of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:06:58 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[11dad91b-11c9-4e0b-997a-46aa24a73f95]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:06:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:59 devstack sudo[90161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:06:59 devstack sudo[90161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:59 devstack sudo[90161]: pam_unix(sudo:session): session closed for user root Jul 06 21:06:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.906s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:06:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:06:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:06:59 devstack sudo[90180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c 1G Jul 06 21:06:59 devstack sudo[90180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:06:59 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Flow 'volume_create_manager' (2ba5f4b9-ec67-461d-a59e-56540dcc7286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb290209-b6e1-48b8-9344-6dd4b0477b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb290209-b6e1-48b8-9344-6dd4b0477b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1586093890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ffb3394-7254-4c8e-a43b-accc79c21a8f,host='devstack@QuobyteHD#QuobyteHD',id=7aced178-5486-473a-887b-f31a32396e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc3fbd10e0437095473642b60cbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:00Z,use_quota=True,user_id='6c42d77b61094b95a90bfc447dcb6f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdc7c465-83ab-400a-b1ee-4636145edbcf),volume_type_id=cdc7c465-83ab-400a-b1ee-4636145edbcf)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0c0331-9b2e-4150-9c74-fadb63a39510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ef0c0331-9b2e-4150-9c74-fadb63a39510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb3d751-ba71-4de7-8319-e528d13e02ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fbb3d751-ba71-4de7-8319-e528d13e02ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7aced178-5486-473a-887b-f31a32396e4f', 'volume_name': 'volume-7aced178-5486-473a-887b-f31a32396e4f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d74d941-f9cd-40be-bdb7-34ae812de7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d74d941-f9cd-40be-bdb7-34ae812de7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa06764-330a-4527-a4ce-db29ecbe25e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:00 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Volume 7aced178-5486-473a-887b-f31a32396e4f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7aced178-5486-473a-887b-f31a32396e4f', 'volume_size': 1} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:00 devstack sudo[90180]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c 1G" returned: 0 in 0.966s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:00 devstack sudo[90192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c Jul 06 21:07:00 devstack sudo[90192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:01 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-02b58c22-4434-4489-b474-339360d80e65 tempest-ServerActionsTestOtherA-99214274 None] Terminate volume connection completed successfully. Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-02b58c22-4434-4489-b474-339360d80e65 tempest-ServerActionsTestOtherA-99214274 None] Deleting attachment a50feb00-ae9c-4e66-8d69-6b738f3bcf37. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:01 devstack sudo[90247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:07:01 devstack sudo[90247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:01 devstack sudo[90247]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.712s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:01 devstack sudo[90192]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" returned: 0 in 0.987s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:01 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c is being set with open permissions: ugo+rw Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:07:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:07:01 devstack sudo[90253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c Jul 06 21:07:01 devstack sudo[90253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:02 devstack sudo[90253]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" returned: 0 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.782s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.542s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6ffb3394-7254-4c8e-a43b-accc79c21a8f,created_at=2026-07-06T19:06:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1586093890',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6ffb3394-7254-4c8e-a43b-accc79c21a8f,host='devstack@QuobyteHD#QuobyteHD',id=7aced178-5486-473a-887b-f31a32396e4f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc3fbd10e0437095473642b60cbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:00Z,use_quota=True,user_id='6c42d77b61094b95a90bfc447dcb6f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cdc7c465-83ab-400a-b1ee-4636145edbcf),volume_type_id=cdc7c465-83ab-400a-b1ee-4636145edbcf)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Creating volume 7aced178-5486-473a-887b-f31a32396e4f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:07:02 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:07:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:02 devstack sudo[90276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f 1073741824 Jul 06 21:07:02 devstack sudo[90276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-57f7fdc2-6e3a-447c-8cb1-74b7e149a20b tempest-SnapshotsActionsTest-1963226023 None] Create snapshot completed successfully Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-99c92924-f67c-42b4-b1b6-8d14e1fc5a6c-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-99c92924-f67c-42b4-b1b6-8d14e1fc5a6c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Deleting offline snapshot 99c92924-f67c-42b4-b1b6-8d14e1fc5a6c of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] snapshot_file for this snap is: volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[93355202-9f1a-481e-b057-90bebbecc391]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:03 devstack sudo[90283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c Jul 06 21:07:03 devstack sudo[90283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-d4850919-e23a-4012-b8a4-d9a3d82b5962 tempest-ServerActionsTestOtherA-99214274 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:03 devstack sudo[90276]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f 1073741824" returned: 0 in 0.974s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:03 devstack sudo[90293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f Jul 06 21:07:03 devstack sudo[90293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:04 devstack sudo[90283]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" returned: 0 in 0.802s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f1a62b-84ea-43af-9b62-7ef4eac519a6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:04 devstack sudo[90298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:04 devstack sudo[90298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:04 devstack sudo[90293]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] <== create_volume: return (1675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.679s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-d4850919-e23a-4012-b8a4-d9a3d82b5962 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.759s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfa06764-330a-4527-a4ce-db29ecbe25e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7aced178-5486-473a-887b-f31a32396e4f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6769fb9a-9764-4167-bbf9-a98c0f194f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbc3d63a-65d7-433a-970e-c57076a947b0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-d4850919-e23a-4012-b8a4-d9a3d82b5962 tempest-ServerActionsTestOtherA-99214274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Volume volume-7aced178-5486-473a-887b-f31a32396e4f (7aced178-5486-473a-887b-f31a32396e4f): created successfully Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6769fb9a-9764-4167-bbf9-a98c0f194f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Flow 'volume_create_manager' (2ba5f4b9-ec67-461d-a59e-56540dcc7286) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:04 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d6691b9a-dd42-471d-adad-70077013fcad tempest-GroupsTest-823545862 None] Created volume successfully. Jul 06 21:07:04 devstack sudo[90301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 Jul 06 21:07:04 devstack sudo[90301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:05 devstack sudo[90298]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.885s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:05 devstack sudo[90310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c Jul 06 21:07:05 devstack sudo[90310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:05 devstack sudo[90301]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-d4850919-e23a-4012-b8a4-d9a3d82b5962 tempest-ServerActionsTestOtherA-99214274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61" returned: 0 in 0.775s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-d4850919-e23a-4012-b8a4-d9a3d82b5962 tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.802s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-d4850919-e23a-4012-b8a4-d9a3d82b5962 tempest-ServerActionsTestOtherA-99214274 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-8747152a-91e9-4eda-9222-ceb8e49e3f61', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6132329-8391-413b-95a2-79a6fb19b5c2', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:07:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-aaf8d3ab-6d7d-401a-82c7-8d466e3acfae req-d4850919-e23a-4012-b8a4-d9a3d82b5962 tempest-ServerActionsTestOtherA-99214274 None] attachment_update completed successfully. Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Acquiring lock "cinder-quobyte-7aced178-5486-473a-887b-f31a32396e4f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Lock "cinder-quobyte-7aced178-5486-473a-887b-f31a32396e4f" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cc37499-e620-476f-82a1-c9763d9bdfd2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:05 devstack sudo[90312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f Jul 06 21:07:05 devstack sudo[90312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:05 devstack sudo[90310]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" returned: 0 in 0.773s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:05 devstack sudo[90317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c Jul 06 21:07:05 devstack sudo[90317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:06 devstack sudo[90312]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f" returned: 0 in 0.835s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:06 devstack sudo[90323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f Jul 06 21:07:06 devstack sudo[90323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:06 devstack sudo[90317]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-99c92924-f67c-42b4-b1b6-8d14e1fc5a6c" released by "_delete_snapshot" :: held 3.235s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" released by "delete_snapshot" :: held 3.273s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:06 devstack cinder-volume[87273]: WARNING cinder.quota [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Created reservations ['da1b2b2b-36ff-4aed-abff-67fe1333626f', '4cde160e-0e9c-40ad-b758-262c800e01fe', '7da9e4ac-50d8-49cd-ad01-cb9eb01fb336', 'a8ffa095-dbe3-45b3-9bba-0741f3aa1363'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Delete snapshot completed successfully. Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7703368f-07a8-451e-89e2-b781f6c205a6 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-99c92924-f67c-42b4-b1b6-8d14e1fc5a6c-delete_snapshot" released by "delete_snapshot" :: held 3.459s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:06 devstack sudo[90323]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7aced178-5486-473a-887b-f31a32396e4f" returned: 0 in 0.657s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Lock "cinder-quobyte-7aced178-5486-473a-887b-f31a32396e4f" released by "delete_volume" :: held 1.539s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Created reservations ['7b9bc9cd-0668-4e37-9f59-5513d538f7d6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:07 devstack cinder-volume[87273]: WARNING cinder.quota [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1227976548 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1227976548, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:07:07 devstack cinder-volume[87273]: WARNING cinder.quota [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1227976548 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1227976548, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Created reservations ['732d5cac-9b33-4499-9ea6-cfe1d71c5fe4', '64af68e6-8219-4270-97cb-65f26a6b8597', 'cc13567d-250f-453b-b66d-efebc9bb3853', 'c09b1155-9c57-467e-9368-8c0f0869c499'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:07 devstack sudo[90327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:07:07 devstack sudo[90327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Creating offline snapshot 6f1d6ceb-2c7d-459a-99da-05c1d1a1960c of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:07:08 devstack sudo[90327]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.861s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ccea0283-9607-426e-9f7e-931aa4c99c30 tempest-GroupsTest-823545862 None] Delete group completed successfully. Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[761ca46c-0437-4029-9915-0eb4032023eb]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Created reservations ['f158d25e-930e-4f03-bcae-f675e93c4e87'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:08 devstack sudo[90347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:08 devstack sudo[90347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:08 devstack sudo[90348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:07:08 devstack sudo[90348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:08 devstack sudo[90348]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.686s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:08 devstack sudo[90347]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3c08c97c-1a8b-4f49-a05a-ed8bc837e0e6 tempest-GroupsTest-823545862 None] Delete group completed successfully. Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.789s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:08 devstack sudo[90423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c 1G Jul 06 21:07:08 devstack sudo[90423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a0a00eca-b693-4273-9e58-19c92467d859 tempest-GroupsTest-823545862 None] Group tempest-GroupsTest-Group-351025012: creating Jul 06 21:07:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a0a00eca-b693-4273-9e58-19c92467d859 tempest-GroupsTest-823545862 None] Group tempest-GroupsTest-Group-351025012: created successfully Jul 06 21:07:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a0a00eca-b693-4273-9e58-19c92467d859 tempest-GroupsTest-823545862 None] Create group completed successfully. Jul 06 21:07:10 devstack sudo[90423]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c 1G" returned: 0 in 1.343s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:10 devstack sudo[90449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c Jul 06 21:07:10 devstack sudo[90449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:10 devstack sudo[90449]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" returned: 0 in 0.797s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:10 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c is being set with open permissions: ugo+rw Jul 06 21:07:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:10 devstack sudo[90457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c Jul 06 21:07:10 devstack sudo[90457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Flow 'volume_create_manager' (32d420a7-9ee6-4ff7-8683-65e68d2ebeb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bba4f5-db29-4d25-83b1-c89dce3047c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d4bba4f5-db29-4d25-83b1-c89dce3047c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487414918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a43e44-9549-4e72-8b38-849a88b37969,host='devstack@QuobyteHD#QuobyteHD',id=ea0fab0c-0c82-4eee-b73a-59c9df9cd068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc3fbd10e0437095473642b60cbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:12Z,use_quota=True,user_id='6c42d77b61094b95a90bfc447dcb6f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(747f8da9-ca58-4721-bccb-451b7557600d),volume_type_id=747f8da9-ca58-4721-bccb-451b7557600d)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733ab850-8840-467b-84c6-594f0b705aab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733ab850-8840-467b-84c6-594f0b705aab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e4d866-e352-4752-95f1-7874fbffc6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f7e4d866-e352-4752-95f1-7874fbffc6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea0fab0c-0c82-4eee-b73a-59c9df9cd068', 'volume_name': 'volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda0c64-934a-406c-926c-e67f20c3a106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8fda0c64-934a-406c-926c-e67f20c3a106) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7de825-ab43-4ea7-a201-fab896117899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:11 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Volume ea0fab0c-0c82-4eee-b73a-59c9df9cd068: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068', 'volume_size': 1} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:11 devstack sudo[90457]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" returned: 0 in 0.809s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.845s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2a43e44-9549-4e72-8b38-849a88b37969,created_at=2026-07-06T19:07:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1487414918',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a43e44-9549-4e72-8b38-849a88b37969,host='devstack@QuobyteHD#QuobyteHD',id=ea0fab0c-0c82-4eee-b73a-59c9df9cd068,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc3fbd10e0437095473642b60cbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:12Z,use_quota=True,user_id='6c42d77b61094b95a90bfc447dcb6f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(747f8da9-ca58-4721-bccb-451b7557600d),volume_type_id=747f8da9-ca58-4721-bccb-451b7557600d)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Creating volume ea0fab0c-0c82-4eee-b73a-59c9df9cd068 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:07:11 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:07:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:11 devstack sudo[90795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 1073741824 Jul 06 21:07:11 devstack sudo[90795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:11 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2e7d14ca-8d3c-45c7-9beb-2f4d1574894c tempest-SnapshotsActionsTest-1963226023 None] Create snapshot completed successfully Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-6f1d6ceb-2c7d-459a-99da-05c1d1a1960c-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-6f1d6ceb-2c7d-459a-99da-05c1d1a1960c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Deleting offline snapshot 6f1d6ceb-2c7d-459a-99da-05c1d1a1960c of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] snapshot_file for this snap is: volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[42ea6bdb-ada2-48ab-a623-7ffea023468b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:12 devstack sudo[90798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c Jul 06 21:07:12 devstack sudo[90798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:12 devstack sudo[90795]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 1073741824" returned: 0 in 0.915s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:12 devstack sudo[90805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 Jul 06 21:07:12 devstack sudo[90805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:13 devstack sudo[90798]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" returned: 0 in 1.070s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0668b37c-f95e-444f-8a5a-8b94e805b24b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:13 devstack sudo[90805]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068" returned: 0 in 0.848s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] <== create_volume: return (1808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.810s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:13 devstack sudo[90811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:13 devstack sudo[90811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7de825-ab43-4ea7-a201-fab896117899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5277dc67-0a9f-409f-9e25-a97cd9a9e834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Volume volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 (ea0fab0c-0c82-4eee-b73a-59c9df9cd068): created successfully Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5277dc67-0a9f-409f-9e25-a97cd9a9e834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Flow 'volume_create_manager' (32d420a7-9ee6-4ff7-8683-65e68d2ebeb4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-67db0a72-1317-4c1d-a998-0151b882e4a7 tempest-GroupsTest-823545862 None] Created volume successfully. Jul 06 21:07:14 devstack sudo[90811]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 1.321s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:14 devstack sudo[90816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c Jul 06 21:07:14 devstack sudo[90816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Flow 'volume_create_manager' (35a8b295-47e9-45e4-962f-fb6dcebc9ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b9f0d1-1bd8-46bb-90bb-bc9e47d8c338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b1b9f0d1-1bd8-46bb-90bb-bc9e47d8c338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238667017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a43e44-9549-4e72-8b38-849a88b37969,host='devstack@QuobyteHD#QuobyteHD',id=0641dde8-38a1-48b5-b479-6e988fe50d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc3fbd10e0437095473642b60cbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:15Z,use_quota=True,user_id='6c42d77b61094b95a90bfc447dcb6f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(747f8da9-ca58-4721-bccb-451b7557600d),volume_type_id=747f8da9-ca58-4721-bccb-451b7557600d)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340dd536-9291-4ac4-8faa-3ae5aaea43ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (340dd536-9291-4ac4-8faa-3ae5aaea43ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cf249b-2f4a-428a-bd29-e44a78142f3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (19cf249b-2f4a-428a-bd29-e44a78142f3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0641dde8-38a1-48b5-b479-6e988fe50d18', 'volume_name': 'volume-0641dde8-38a1-48b5-b479-6e988fe50d18', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc4f3db-fa06-4645-8606-e4891aca0a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dc4f3db-fa06-4645-8606-e4891aca0a28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15877fcc-b8ac-4d95-9af6-5115c81423e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:15 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Volume 0641dde8-38a1-48b5-b479-6e988fe50d18: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0641dde8-38a1-48b5-b479-6e988fe50d18', 'volume_size': 1} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d2a43e44-9549-4e72-8b38-849a88b37969,created_at=2026-07-06T19:07:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-238667017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d2a43e44-9549-4e72-8b38-849a88b37969,host='devstack@QuobyteHD#QuobyteHD',id=0641dde8-38a1-48b5-b479-6e988fe50d18,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='56dc3fbd10e0437095473642b60cbfd9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:15Z,use_quota=True,user_id='6c42d77b61094b95a90bfc447dcb6f39',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(747f8da9-ca58-4721-bccb-451b7557600d),volume_type_id=747f8da9-ca58-4721-bccb-451b7557600d)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Creating volume 0641dde8-38a1-48b5-b479-6e988fe50d18 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:07:15 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:15 devstack sudo[90818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 1073741824 Jul 06 21:07:15 devstack sudo[90818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:15 devstack sudo[90816]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" returned: 0 in 1.127s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:15 devstack sudo[90830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c Jul 06 21:07:15 devstack sudo[90830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:16 devstack sudo[90818]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 1073741824" returned: 0 in 1.063s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:16 devstack sudo[90833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 Jul 06 21:07:16 devstack sudo[90833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:16 devstack sudo[90830]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" returned: 0 in 0.799s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-6f1d6ceb-2c7d-459a-99da-05c1d1a1960c" released by "_delete_snapshot" :: held 4.489s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" released by "delete_snapshot" :: held 4.526s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Created reservations ['4eb427b0-5311-49b3-b0c3-c4e43bcca704', '2e526c89-e957-4664-ae38-676f3d8c613c', 'dfac7bca-b134-4088-b827-9ceb91ad3a26', 'a435b53c-07ed-4473-a462-ac1601792c37'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:16 devstack sudo[90833]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:16 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Delete snapshot completed successfully. Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18" returned: 0 in 0.673s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eb66a818-4b39-4943-b0b7-6a75011bb912 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-6f1d6ceb-2c7d-459a-99da-05c1d1a1960c-delete_snapshot" released by "delete_snapshot" :: held 4.722s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15877fcc-b8ac-4d95-9af6-5115c81423e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0641dde8-38a1-48b5-b479-6e988fe50d18', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fb776c-17a3-483b-8c41-03ff2ad05075) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:17 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Volume volume-0641dde8-38a1-48b5-b479-6e988fe50d18 (0641dde8-38a1-48b5-b479-6e988fe50d18): created successfully Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04fb776c-17a3-483b-8c41-03ff2ad05075) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Flow 'volume_create_manager' (35a8b295-47e9-45e4-962f-fb6dcebc9ebf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f40064c6-b99e-425c-922b-bf8f6dfd11fa tempest-GroupsTest-823545862 None] Created volume successfully. Jul 06 21:07:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b4753a12-e62f-4776-9d36-7071ca1eea9c tempest-GroupsTest-823545862 None] Update group completed successfully. Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Creating offline snapshot 08a0e4e7-1069-4fc1-8f6a-577eddebe662 of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c6cab38-93bd-4b59-81d8-8b4f861484bf]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:18 devstack sudo[90838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:18 devstack sudo[90838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:18 devstack sudo[90838]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.832s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:18 devstack sudo[90843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 1G Jul 06 21:07:18 devstack sudo[90843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-098b3b48-ba3a-4725-8464-7de0094e0a69 tempest-GroupsTest-823545862 None] Update group completed successfully. Jul 06 21:07:20 devstack sudo[90843]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 1G" returned: 0 in 1.457s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:20 devstack sudo[90894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 Jul 06 21:07:20 devstack sudo[90894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:20 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=97,cinder:SELECT=122,cinder:DELETE=4,cinder:INSERT=17 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:07:20 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=103,cinder:SELECT=96,cinder:INSERT=25,cinder:DELETE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:07:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Acquiring lock "cinder-quobyte-0641dde8-38a1-48b5-b479-6e988fe50d18" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Lock "cinder-quobyte-0641dde8-38a1-48b5-b479-6e988fe50d18" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7943a5ce-fb49-48ca-b254-bee0b96f3c68]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:21 devstack sudo[90902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 Jul 06 21:07:21 devstack sudo[90902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:21 devstack sudo[90894]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662" returned: 0 in 0.934s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:21 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 is being set with open permissions: ugo+rw Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:21 devstack sudo[90904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 Jul 06 21:07:21 devstack sudo[90904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:21 devstack sudo[90902]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18" returned: 0 in 0.803s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:21 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18 Jul 06 21:07:21 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:21 devstack sudo[90904]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.979s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-25a2cf22-3663-4033-9ce0-a8eafc157ed0 tempest-SnapshotsActionsTest-1963226023 None] Create snapshot completed successfully Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-08a0e4e7-1069-4fc1-8f6a-577eddebe662-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-08a0e4e7-1069-4fc1-8f6a-577eddebe662-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-08a0e4e7-1069-4fc1-8f6a-577eddebe662" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-08a0e4e7-1069-4fc1-8f6a-577eddebe662" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Deleting offline snapshot 08a0e4e7-1069-4fc1-8f6a-577eddebe662 of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] snapshot_file for this snap is: volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[43c275be-6fad-4982-90b0-3cf536159e5f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:22 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0641dde8-38a1-48b5-b479-6e988fe50d18" returned: 0 in 0.707s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Lock "cinder-quobyte-0641dde8-38a1-48b5-b479-6e988fe50d18" released by "delete_volume" :: held 1.570s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Acquiring lock "cinder-quobyte-ea0fab0c-0c82-4eee-b73a-59c9df9cd068" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Lock "cinder-quobyte-ea0fab0c-0c82-4eee-b73a-59c9df9cd068" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:22 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 Jul 06 21:07:22 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a44f554-207c-435c-aa97-094a4dabda77]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:22 devstack sudo[90916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 Jul 06 21:07:22 devstack sudo[90916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:23 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662" returned: 0 in 0.805s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:23 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d463953-ad50-4d0e-83fa-080256e7458d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:23 devstack sudo[90916]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:23 devstack sudo[90929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:23 devstack sudo[90929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:23 devstack sudo[90930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068 Jul 06 21:07:23 devstack sudo[90930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:24 devstack sudo[90930]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ea0fab0c-0c82-4eee-b73a-59c9df9cd068" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Lock "cinder-quobyte-ea0fab0c-0c82-4eee-b73a-59c9df9cd068" released by "delete_volume" :: held 1.551s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:24 devstack sudo[90929]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.834s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:24 devstack sudo[90937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 Jul 06 21:07:24 devstack sudo[90937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Created reservations ['a89c1d86-478e-45bb-b381-9aa99446b78f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:24 devstack cinder-volume[87273]: WARNING cinder.quota [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-810896856 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-810896856, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:07:24 devstack cinder-volume[87273]: WARNING cinder.quota [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-810896856 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-810896856, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Created reservations ['f52a01c4-8f18-47ed-99e5-3743411cc447', 'b45d8d76-421e-4d52-b7ff-d0a171d64fb1', '8012b521-dc5a-4d73-9530-8449905f3843', 'd56e8610-9008-408e-826e-963bc809fdb0'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Created reservations ['229ce7f3-da9e-47d4-aabf-4c879e744a76', '31207624-1932-4753-8748-ecc49651235c', 'b7eb6677-8821-4fe6-ad35-83c40ceda358', 'ac07ec21-d238-4e3e-9ef1-5b2b44471e86'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:24 devstack sudo[90939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:07:24 devstack sudo[90939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:25 devstack sudo[90937]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662" returned: 0 in 0.881s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:25 devstack sudo[90951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662 Jul 06 21:07:25 devstack sudo[90951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:25 devstack sudo[90939]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.871s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a0367ec4-5f08-48d3-8a37-ed64b040dd11 tempest-GroupsTest-823545862 None] Delete group completed successfully. Jul 06 21:07:25 devstack sudo[90951]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.08a0e4e7-1069-4fc1-8f6a-577eddebe662" returned: 0 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-08a0e4e7-1069-4fc1-8f6a-577eddebe662" released by "_delete_snapshot" :: held 3.429s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" released by "delete_snapshot" :: held 3.460s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:25 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Created reservations ['39100b06-7d0c-4898-ab04-6bfe8c5a793c', '9962b7ad-a4e9-48c1-ae40-aaec69d790a9', '4f1e64c4-f1ed-4a8b-a4fe-2b887943ff6d', 'c20c1a6c-1ffc-46d1-9db0-528e89effae9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Delete snapshot completed successfully. Jul 06 21:07:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ab90eaf-4567-477a-8c0c-9ce20c8f28f3 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-08a0e4e7-1069-4fc1-8f6a-577eddebe662-delete_snapshot" released by "delete_snapshot" :: held 3.641s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-82eada55-a65c-4706-81a3-a21328c4ec20 req-b9a643d4-d118-4f39-a62b-26b2877f377b tempest-TaggedAttachmentsTest-114923880 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-82eada55-a65c-4706-81a3-a21328c4ec20 req-b9a643d4-d118-4f39-a62b-26b2877f377b tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa481e52-d5e1-417f-a72a-4ad190422496]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-82eada55-a65c-4706-81a3-a21328c4ec20 req-b9a643d4-d118-4f39-a62b-26b2877f377b tempest-TaggedAttachmentsTest-114923880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:26 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a Jul 06 21:07:26 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:27 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-82eada55-a65c-4706-81a3-a21328c4ec20 req-b9a643d4-d118-4f39-a62b-26b2877f377b tempest-TaggedAttachmentsTest-114923880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a" returned: 0 in 0.847s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-82eada55-a65c-4706-81a3-a21328c4ec20 req-b9a643d4-d118-4f39-a62b-26b2877f377b tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.213s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Creating offline snapshot 6688f6dd-1c1d-4b34-a50f-5110866b68f7 of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[56d739eb-9985-477f-8c65-6d2a3b313901]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-82eada55-a65c-4706-81a3-a21328c4ec20 req-b9a643d4-d118-4f39-a62b-26b2877f377b tempest-TaggedAttachmentsTest-114923880 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fcc3ba03-f82e-41a9-b0b1-5fab3a363bb0', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:07:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-82eada55-a65c-4706-81a3-a21328c4ec20 req-b9a643d4-d118-4f39-a62b-26b2877f377b tempest-TaggedAttachmentsTest-114923880 None] attachment_update completed successfully. Jul 06 21:07:27 devstack sudo[91008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:27 devstack sudo[91008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:28 devstack sudo[91008]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.780s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:28 devstack sudo[91014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 1G Jul 06 21:07:28 devstack sudo[91014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:28 devstack sudo[91014]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 1G" returned: 0 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:28 devstack sudo[91046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 Jul 06 21:07:28 devstack sudo[91046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:29 devstack sudo[91046]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7" returned: 0 in 0.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:29 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 is being set with open permissions: ugo+rw Jul 06 21:07:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:29 devstack sudo[91051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 Jul 06 21:07:29 devstack sudo[91051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:30 devstack sudo[91051]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7" returned: 0 in 0.625s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d2de300e-efe9-40fd-9682-9b4342ede6b8 tempest-SnapshotsActionsTest-1963226023 None] Create snapshot completed successfully Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-6688f6dd-1c1d-4b34-a50f-5110866b68f7-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-6688f6dd-1c1d-4b34-a50f-5110866b68f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Acquiring lock "cinder-quobyte-6688f6dd-1c1d-4b34-a50f-5110866b68f7" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-6688f6dd-1c1d-4b34-a50f-5110866b68f7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Deleting offline snapshot 6688f6dd-1c1d-4b34-a50f-5110866b68f7 of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] snapshot_file for this snap is: volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7484bca3-40b0-40b9-8d95-53e6341fbf92]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:31 devstack sudo[91056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 Jul 06 21:07:31 devstack sudo[91056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:32 devstack sudo[91056]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7" returned: 0 in 1.057s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[80219a05-751c-4d15-b29b-5447554c59de]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:32 devstack sudo[91064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:32 devstack sudo[91064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:33 devstack sudo[91064]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.881s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:33 devstack sudo[91070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 Jul 06 21:07:33 devstack sudo[91070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:34 devstack sudo[91070]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7" returned: 0 in 0.899s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:34 devstack sudo[91079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7 Jul 06 21:07:34 devstack sudo[91079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-4ea469d4-a5be-4b24-93b7-2af6f48a9b50 req-730067e1-d915-4f55-a91c-59ce51ffcb9f tempest-TaggedAttachmentsTest-114923880 None] Terminate volume connection completed successfully. Jul 06 21:07:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-4ea469d4-a5be-4b24-93b7-2af6f48a9b50 req-730067e1-d915-4f55-a91c-59ce51ffcb9f tempest-TaggedAttachmentsTest-114923880 None] Deleting attachment fcc3ba03-f82e-41a9-b0b1-5fab3a363bb0. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:07:35 devstack sudo[91079]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.6688f6dd-1c1d-4b34-a50f-5110866b68f7" returned: 0 in 0.704s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-6688f6dd-1c1d-4b34-a50f-5110866b68f7" released by "_delete_snapshot" :: held 3.676s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" released by "delete_snapshot" :: held 3.710s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:35 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Created reservations ['09f4b9ec-f319-49b9-bd9f-623413b070dd', 'b525e955-56af-4aba-96c1-b5bbaafadd02', '5ae2eb67-6115-498a-b3d7-c12cfdadd78d', '54a78880-569f-4781-8f9f-2c6c153c9304'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Delete snapshot completed successfully. Jul 06 21:07:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-372bbc61-ae6a-4401-be1d-1be085457543 tempest-SnapshotsActionsTest-1316107424 None] Lock "cinder-6688f6dd-1c1d-4b34-a50f-5110866b68f7-delete_snapshot" released by "delete_snapshot" :: held 3.869s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "cinder-ae2b160b-18e9-43ba-b138-eb561cbf6bf7-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-ae2b160b-18e9-43ba-b138-eb561cbf6bf7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "cinder-quobyte-ae2b160b-18e9-43ba-b138-eb561cbf6bf7" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-quobyte-ae2b160b-18e9-43ba-b138-eb561cbf6bf7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Deleting offline snapshot ae2b160b-18e9-43ba-b138-eb561cbf6bf7 of volume d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] snapshot_file for this snap is: volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d3a1d7d-9a1c-4cf6-bca6-f857ee899caa]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:36 devstack sudo[91087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:36 devstack sudo[91087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-9a6846a9-8995-4f12-8871-26ee9ce6f201 req-36c79798-fb9a-4866-8f17-43abce5aa52e tempest-ServerActionsTestOtherA-99214274 None] Terminate volume connection completed successfully. Jul 06 21:07:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-9a6846a9-8995-4f12-8871-26ee9ce6f201 req-36c79798-fb9a-4866-8f17-43abce5aa52e tempest-ServerActionsTestOtherA-99214274 None] Deleting attachment e6132329-8391-413b-95a2-79a6fb19b5c2. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:07:37 devstack sudo[91087]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.856s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:07:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe32bf9-7ac0-42cf-8b81-8f91efe71358]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:37 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d Jul 06 21:07:37 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:38 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" returned: 0 in 1.160s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:38 devstack sudo[91129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:38 devstack sudo[91129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:39 devstack sudo[91129]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.838s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:39 devstack sudo[91136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7 Jul 06 21:07:39 devstack sudo[91136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:39 devstack sudo[91136]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d.ae2b160b-18e9-43ba-b138-eb561cbf6bf7" returned: 0 in 0.706s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-quobyte-ae2b160b-18e9-43ba-b138-eb561cbf6bf7" released by "_delete_snapshot" :: held 3.739s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" released by "delete_snapshot" :: held 3.771s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:39 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Created reservations ['2305a115-49fa-47c4-b220-38b91d8fc72e', 'b0d351c8-4154-4dcd-8686-a723c724b377', '6aed9e66-5166-45c7-bf77-6d7117a64198', 'cde8db26-f1f5-49e4-9714-119bc749b33a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Delete snapshot completed successfully. Jul 06 21:07:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-04d9beee-2253-4ee7-8790-8f94fe1fd860 tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-ae2b160b-18e9-43ba-b138-eb561cbf6bf7-delete_snapshot" released by "delete_snapshot" :: held 3.932s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "cinder-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bc36d60-0fe4-4527-9777-da8a252cd37c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:40 devstack sudo[91181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d Jul 06 21:07:40 devstack sudo[91181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:41 devstack sudo[91181]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" returned: 0 in 1.158s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:41 devstack sudo[91215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d Jul 06 21:07:41 devstack sudo[91215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:42 devstack sudo[91215]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" returned: 0 in 1.050s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-quobyte-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d" released by "delete_volume" :: held 2.295s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:43 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Created reservations ['f039d48c-88c6-4f5f-85d9-b934ab17a65d', '90c75fc5-825e-42c4-987a-7ff17858d5bf', '31d2eb49-25b8-4dee-bf21-e3019d0a6122', '96786333-46c9-422f-9485-425e052e1400'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:43 devstack sudo[91226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:07:43 devstack sudo[91226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:44 devstack sudo[91226]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.816s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:44 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Deleted volume successfully. Jul 06 21:07:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0e0b6416-600a-4dee-a9d1-a11d14aef7cd tempest-SnapshotsActionsTest-1963226023 None] Lock "cinder-d3b2dbab-ba9e-4e9e-891e-fe3ca296f31d-delete_volume" released by "delete_volume" :: held 3.579s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Acquiring lock "cinder-8747152a-91e9-4eda-9222-ceb8e49e3f61-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Lock "cinder-8747152a-91e9-4eda-9222-ceb8e49e3f61-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Acquiring lock "cinder-quobyte-8747152a-91e9-4eda-9222-ceb8e49e3f61" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Lock "cinder-quobyte-8747152a-91e9-4eda-9222-ceb8e49e3f61" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5c8b469-ef86-414e-8a36-10f092796885]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:48 devstack sudo[91262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 Jul 06 21:07:48 devstack sudo[91262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:48 devstack sudo[91262]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61" returned: 0 in 0.817s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:48 devstack sudo[91268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61 Jul 06 21:07:48 devstack sudo[91268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:49 devstack sudo[91268]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8747152a-91e9-4eda-9222-ceb8e49e3f61" returned: 0 in 0.702s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Lock "cinder-quobyte-8747152a-91e9-4eda-9222-ceb8e49e3f61" released by "delete_volume" :: held 1.569s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Created reservations ['b6011827-0385-4a25-970d-848ae3e3aef5', '5d18ae29-85cf-48e6-9b00-24651686af91', 'e68d0051-9486-4342-b92c-0d334d428f03', '5baa1470-b0b7-4978-b528-6e652d73ae2e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:49 devstack sudo[91271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:07:49 devstack sudo[91271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:50 devstack sudo[91271]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.753s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:50 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Deleted volume successfully. Jul 06 21:07:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-47f32ec9-ed6d-4864-921a-3882a317e28f tempest-ServerActionsTestOtherA-99214274 None] Lock "cinder-8747152a-91e9-4eda-9222-ceb8e49e3f61-delete_volume" released by "delete_volume" :: held 2.559s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Acquiring lock "cinder-8a8b9284-1ef3-46e9-bdb8-772116693e1a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Lock "cinder-8a8b9284-1ef3-46e9-bdb8-772116693e1a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Acquiring lock "cinder-quobyte-8a8b9284-1ef3-46e9-bdb8-772116693e1a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Lock "cinder-quobyte-8a8b9284-1ef3-46e9-bdb8-772116693e1a" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c2c6f78-4f23-45d4-8a95-946168e84740]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:54 devstack sudo[91304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a Jul 06 21:07:54 devstack sudo[91304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Flow 'volume_create_manager' (727da935-66ac-4596-bf3d-051e1a5bd5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d4343c-a98b-4c9f-9ccd-09a3030fb3b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9d4343c-a98b-4c9f-9ccd-09a3030fb3b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-623926150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb191eda-14b5-4cf6-aa9a-ff4e60e82117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1fe6d17807d45d7b1f87c7409158a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:56Z,use_quota=True,user_id='1858bc89c0cf4fc69034829e3652a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b417871-bd61-4849-a75a-b8bfd94c3d31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0b417871-bd61-4849-a75a-b8bfd94c3d31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349db892-f9a2-4d4a-b1ce-c3ef71fa32ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (349db892-f9a2-4d4a-b1ce-c3ef71fa32ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fb191eda-14b5-4cf6-aa9a-ff4e60e82117', 'volume_name': 'volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0254a3b5-8b55-4914-9ab0-01a0fed5b3fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0254a3b5-8b55-4914-9ab0-01a0fed5b3fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400383b5-f1e0-4c64-8752-ff7d62cc1613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:55 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Volume fb191eda-14b5-4cf6-aa9a-ff4e60e82117: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117', 'volume_size': 1} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:07:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-623926150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fb191eda-14b5-4cf6-aa9a-ff4e60e82117,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1fe6d17807d45d7b1f87c7409158a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:56Z,use_quota=True,user_id='1858bc89c0cf4fc69034829e3652a87d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Creating volume fb191eda-14b5-4cf6-aa9a-ff4e60e82117 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:55 devstack sudo[91304]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:07:55 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a" returned: 0 in 0.924s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:55 devstack sudo[91317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 1073741824 Jul 06 21:07:55 devstack sudo[91317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:55 devstack sudo[91318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a Jul 06 21:07:55 devstack sudo[91318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:56 devstack sudo[91318]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8a8b9284-1ef3-46e9-bdb8-772116693e1a" returned: 0 in 0.759s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Lock "cinder-quobyte-8a8b9284-1ef3-46e9-bdb8-772116693e1a" released by "delete_volume" :: held 1.748s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Created reservations ['e80a20fc-c7af-4ef9-8f2a-50c63a4efa24', 'c6936d46-8e08-4221-bf38-9247313c689c', 'fd44fb1d-6f29-4156-b914-cd02cf0bfc66', '9dfa930c-2cf6-4aa0-b018-a5093634ca55'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:56 devstack sudo[91317]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 1073741824" returned: 0 in 0.962s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:56 devstack sudo[91326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:07:56 devstack sudo[91326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:56 devstack sudo[91328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 Jul 06 21:07:56 devstack sudo[91328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:57 devstack sudo[91328]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:57 devstack sudo[91326]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117" returned: 0 in 0.779s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.800s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.847s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:07:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Deleted volume successfully. Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (400383b5-f1e0-4c64-8752-ff7d62cc1613) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db37e098-bb1b-4109-9fb1-74588c0e39ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Volume volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 (fb191eda-14b5-4cf6-aa9a-ff4e60e82117): created successfully Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db37e098-bb1b-4109-9fb1-74588c0e39ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Flow 'volume_create_manager' (727da935-66ac-4596-bf3d-051e1a5bd5a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-014b0958-81b3-4d39-a10c-e34cad28d786 tempest-TaggedAttachmentsTest-114923880 None] Lock "cinder-8a8b9284-1ef3-46e9-bdb8-772116693e1a-delete_volume" released by "delete_volume" :: held 2.882s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:07:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3a1ed159-809c-402d-84bc-0ce4c825f560 tempest-VolumesServicesTestJSON-128817585 None] Created volume successfully. Jul 06 21:07:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Acquiring lock "cinder-fb191eda-14b5-4cf6-aa9a-ff4e60e82117-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Lock "cinder-fb191eda-14b5-4cf6-aa9a-ff4e60e82117-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Acquiring lock "cinder-quobyte-fb191eda-14b5-4cf6-aa9a-ff4e60e82117" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:07:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Lock "cinder-quobyte-fb191eda-14b5-4cf6-aa9a-ff4e60e82117" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:07:58 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[da361998-097d-469f-9b17-dc3aeab9f7a9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:07:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:58 devstack sudo[91334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 Jul 06 21:07:58 devstack sudo[91334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:59 devstack sudo[91334]: pam_unix(sudo:session): session closed for user root Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117" returned: 0 in 1.061s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:59 devstack sudo[91343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117 Jul 06 21:07:59 devstack sudo[91343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Flow 'volume_create_manager' (54e52c79-9cc7-4777-b343-0dc754d1681a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e695018-3bbe-4439-85e3-69171fb5f9aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e695018-3bbe-4439-85e3-69171fb5f9aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1022401921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a911aa37-6676-493d-9801-d4169fa9d00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c936084ce80e46658bf8327a1cb2d68e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:59Z,use_quota=True,user_id='0fa1a62a85b94b02907b53aba978277c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3995352a-cce2-42c2-a3fb-e18b1f187d9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3995352a-cce2-42c2-a3fb-e18b1f187d9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab87c58-4735-4567-a5f2-f389b5273d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ab87c58-4735-4567-a5f2-f389b5273d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a911aa37-6676-493d-9801-d4169fa9d00d', 'volume_name': 'volume-a911aa37-6676-493d-9801-d4169fa9d00d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c765d11e-c238-4063-8446-9812e6322474) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c765d11e-c238-4063-8446-9812e6322474) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4f6a26-a324-4ef9-92ad-6e14480d9012) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:07:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Volume a911aa37-6676-493d-9801-d4169fa9d00d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a911aa37-6676-493d-9801-d4169fa9d00d', 'volume_size': 1} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:07:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1022401921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a911aa37-6676-493d-9801-d4169fa9d00d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c936084ce80e46658bf8327a1cb2d68e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:07:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:07:59Z,use_quota=True,user_id='0fa1a62a85b94b02907b53aba978277c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Creating volume a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:07:59 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:07:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:07:59 devstack sudo[91346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d 1073741824 Jul 06 21:07:59 devstack sudo[91346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:00 devstack sudo[91343]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fb191eda-14b5-4cf6-aa9a-ff4e60e82117" returned: 0 in 0.885s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Lock "cinder-quobyte-fb191eda-14b5-4cf6-aa9a-ff4e60e82117" released by "delete_volume" :: held 2.028s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Created reservations ['c77cf486-9b8e-49eb-af26-091a41fa33ac', 'f7a95c2c-804e-4826-86fd-af11ef62d0b5', '370a8ef3-934f-4edb-959c-0a939f599a3c', '975ccd13-e3f9-46a1-8d13-6c117f8b8b0b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:00 devstack sudo[91352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:08:00 devstack sudo[91352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:00 devstack sudo[91346]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d 1073741824" returned: 0 in 1.255s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:01 devstack sudo[91355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d Jul 06 21:08:01 devstack sudo[91355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:01 devstack sudo[91358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:08:01 devstack sudo[91358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:01 devstack sudo[91352]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.358s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:01 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Deleted volume successfully. Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f75248a-61f7-401a-9739-54780e22daec tempest-VolumesServicesTestJSON-128817585 None] Lock "cinder-fb191eda-14b5-4cf6-aa9a-ff4e60e82117-delete_volume" released by "delete_volume" :: held 3.739s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:01 devstack sudo[91355]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d" returned: 0 in 0.997s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] <== create_volume: return (2344ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.347s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c4f6a26-a324-4ef9-92ad-6e14480d9012) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a911aa37-6676-493d-9801-d4169fa9d00d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5cde4-2a66-4af2-8325-d0629d3cf5c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Volume volume-a911aa37-6676-493d-9801-d4169fa9d00d (a911aa37-6676-493d-9801-d4169fa9d00d): created successfully Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06e5cde4-2a66-4af2-8325-d0629d3cf5c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Flow 'volume_create_manager' (54e52c79-9cc7-4777-b343-0dc754d1681a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:02 devstack sudo[91358]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-70dd23dd-58e8-4ca2-8d01-0b935fb12dcb tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Created volume successfully. Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.955s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Creating offline snapshot 42a1ce9b-af2d-4179-8f55-b5918d8f8430 of volume a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[02b515b2-9d55-4687-82ad-edb225d1c279]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:03 devstack sudo[91364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d Jul 06 21:08:03 devstack sudo[91364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:03 devstack sudo[91364]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:03 devstack sudo[91369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 1G Jul 06 21:08:03 devstack sudo[91369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:04 devstack sudo[91369]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 1G" returned: 0 in 0.886s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a911aa37-6676-493d-9801-d4169fa9d00d -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:04 devstack sudo[91377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a911aa37-6676-493d-9801-d4169fa9d00d -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 Jul 06 21:08:04 devstack sudo[91377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:05 devstack sudo[91377]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a911aa37-6676-493d-9801-d4169fa9d00d -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430" returned: 0 in 0.826s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:05 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 is being set with open permissions: ugo+rw Jul 06 21:08:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:05 devstack sudo[91382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 Jul 06 21:08:05 devstack sudo[91382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:06 devstack sudo[91382]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430" returned: 0 in 0.777s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:06 devstack sudo[91385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.info Jul 06 21:08:06 devstack sudo[91385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:07 devstack sudo[91385]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.info" returned: 0 in 0.842s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:07 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.info is being set with open permissions: ugo+rw Jul 06 21:08:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:07 devstack sudo[91388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.info Jul 06 21:08:07 devstack sudo[91388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:07 devstack sudo[91388]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.info" returned: 0 in 0.760s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.042s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e9238fe2-bd74-40ac-a13a-af0fc010a161 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Create snapshot completed successfully Jul 06 21:08:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "cinder-42a1ce9b-af2d-4179-8f55-b5918d8f8430-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-42a1ce9b-af2d-4179-8f55-b5918d8f8430-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "cinder-quobyte-a911aa37-6676-493d-9801-d4169fa9d00d" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-quobyte-a911aa37-6676-493d-9801-d4169fa9d00d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "cinder-quobyte-42a1ce9b-af2d-4179-8f55-b5918d8f8430" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-quobyte-42a1ce9b-af2d-4179-8f55-b5918d8f8430" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Deleting offline snapshot 42a1ce9b-af2d-4179-8f55-b5918d8f8430 of volume a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:08:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] snapshot_file for this snap is: volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:08:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fdddb39-13b8-43d1-823e-200181d7cfb6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:09 devstack sudo[91393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 Jul 06 21:08:09 devstack sudo[91393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:10 devstack sudo[91393]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430" returned: 0 in 1.043s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a911aa37-6676-493d-9801-d4169fa9d00d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:08:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[02f31520-7084-4922-88be-283ee21bafa4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:10 devstack sudo[91398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d Jul 06 21:08:10 devstack sudo[91398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:11 devstack sudo[91398]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d" returned: 0 in 0.987s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:11 devstack sudo[91404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 Jul 06 21:08:11 devstack sudo[91404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:11 devstack sudo[91404]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430" returned: 0 in 0.837s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:12 devstack sudo[91409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430 Jul 06 21:08:12 devstack sudo[91409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:12 devstack sudo[91409]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d.42a1ce9b-af2d-4179-8f55-b5918d8f8430" returned: 0 in 0.662s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-quobyte-42a1ce9b-af2d-4179-8f55-b5918d8f8430" released by "_delete_snapshot" :: held 3.686s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-quobyte-a911aa37-6676-493d-9801-d4169fa9d00d" released by "delete_snapshot" :: held 3.722s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:12 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Created reservations ['202cd5e6-70b9-48d8-8611-7f086d49270e', 'f072bd6c-0eb0-40a6-b3e9-8cc49271ad09', '251dcdaf-fe59-4a71-9dc6-9398ca9b47b8', 'f8b8176e-3db5-45c9-849a-1306ce23777a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Delete snapshot completed successfully. Jul 06 21:08:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7aa45f59-1d18-48a4-8d56-b93248b8ed42 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-42a1ce9b-af2d-4179-8f55-b5918d8f8430-delete_snapshot" released by "delete_snapshot" :: held 3.898s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "cinder-a911aa37-6676-493d-9801-d4169fa9d00d-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-a911aa37-6676-493d-9801-d4169fa9d00d-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "cinder-quobyte-a911aa37-6676-493d-9801-d4169fa9d00d" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-quobyte-a911aa37-6676-493d-9801-d4169fa9d00d" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:13 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[80aa258b-87df-41ac-b2fe-7bfa805d7efd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:13 devstack sudo[91412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d Jul 06 21:08:13 devstack sudo[91412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:14 devstack sudo[91412]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d" returned: 0 in 0.872s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:14 devstack sudo[91418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d Jul 06 21:08:14 devstack sudo[91418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:15 devstack sudo[91418]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a911aa37-6676-493d-9801-d4169fa9d00d" returned: 0 in 0.829s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-quobyte-a911aa37-6676-493d-9801-d4169fa9d00d" released by "delete_volume" :: held 1.796s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Created reservations ['3725fd08-0b9c-4223-826f-51dba583e4c7', 'd818d29c-8639-4a14-9c86-d273ac594e2d', 'b8a221ec-9a12-41ca-800e-6daf23357ae7', 'bad7bdfd-d59b-45d6-bbf2-4bbd42924659'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:15 devstack sudo[91421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:08:15 devstack sudo[91421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:16 devstack sudo[91421]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.042s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:16 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:16 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Deleted volume successfully. Jul 06 21:08:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab8f21c5-8e69-457b-994d-7b39a4cd9205 tempest-VolumeSnapshotQuotasNegativeTestJSON-1217252608 None] Lock "cinder-a911aa37-6676-493d-9801-d4169fa9d00d-delete_volume" released by "delete_volume" :: held 3.165s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:25 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=69,cinder:DELETE=5,cinder:UPDATE=108,cinder:INSERT=24 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:08:26 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=84,cinder:UPDATE=75,cinder:INSERT=24,cinder:DELETE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Flow 'volume_create_manager' (55ad75cb-3362-4907-a912-3c650fda3231) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5ce0db-2a36-40f0-83a4-2c7ab88164da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f5ce0db-2a36-40f0-83a4-2c7ab88164da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-86033720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b50c94-8f76-49ec-a049-a942e83de728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4a535f70a549e78a3d7a0a29b3f74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:29Z,use_quota=True,user_id='0a26d24a31c743d09472144974babb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e5eb63-fbde-45a9-815a-42bccef455dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c1e5eb63-fbde-45a9-815a-42bccef455dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459207d5-58a5-4126-a88a-f8a83dbda610) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459207d5-58a5-4126-a88a-f8a83dbda610) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21b50c94-8f76-49ec-a049-a942e83de728', 'volume_name': 'volume-21b50c94-8f76-49ec-a049-a942e83de728', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e639e0c-c405-4e7e-86aa-bcb44f98682c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e639e0c-c405-4e7e-86aa-bcb44f98682c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fc7a0c-e473-474e-96c4-a0ec885d1048) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Volume 21b50c94-8f76-49ec-a049-a942e83de728: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21b50c94-8f76-49ec-a049-a942e83de728', 'volume_size': 1} Jul 06 21:08:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-86033720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21b50c94-8f76-49ec-a049-a942e83de728,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4a535f70a549e78a3d7a0a29b3f74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:29Z,use_quota=True,user_id='0a26d24a31c743d09472144974babb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Creating volume 21b50c94-8f76-49ec-a049-a942e83de728 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:29 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:08:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:29 devstack sudo[91444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 1073741824 Jul 06 21:08:29 devstack sudo[91444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:30 devstack sudo[91444]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 1073741824" returned: 0 in 1.006s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:30 devstack sudo[91451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 Jul 06 21:08:30 devstack sudo[91451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:30 devstack sudo[91451]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728" returned: 0 in 0.842s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] <== create_volume: return (1905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.911s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (00fc7a0c-e473-474e-96c4-a0ec885d1048) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21b50c94-8f76-49ec-a049-a942e83de728', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322b588e-3952-4fd5-868e-9325bcb89168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Volume volume-21b50c94-8f76-49ec-a049-a942e83de728 (21b50c94-8f76-49ec-a049-a942e83de728): created successfully Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (322b588e-3952-4fd5-868e-9325bcb89168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Flow 'volume_create_manager' (55ad75cb-3362-4907-a912-3c650fda3231) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-09818949-a2f6-4524-99d2-136658cdc55d tempest-VolumesListAdminTestJSON-1004773519 None] Created volume successfully. Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Flow 'volume_create_manager' (2c4a093d-ca07-402a-a4d6-fbf980d7ad9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02681a44-1edc-4e72-849d-54f6eb540695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (02681a44-1edc-4e72-849d-54f6eb540695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-734419541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae125a1-c3e3-4da9-8749-0312de61500b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4a535f70a549e78a3d7a0a29b3f74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:33Z,use_quota=True,user_id='0a26d24a31c743d09472144974babb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ff2668-1ce3-4be2-becd-802c03c58e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15ff2668-1ce3-4be2-becd-802c03c58e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7300b6fb-7715-48e9-ab49-6efe4f36b84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7300b6fb-7715-48e9-ab49-6efe4f36b84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dae125a1-c3e3-4da9-8749-0312de61500b', 'volume_name': 'volume-dae125a1-c3e3-4da9-8749-0312de61500b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424c5cc2-a38c-4931-897d-d24f4046e745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (424c5cc2-a38c-4931-897d-d24f4046e745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af76fe27-3cf4-44c1-a3a2-c011ca9a0185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:32 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Volume dae125a1-c3e3-4da9-8749-0312de61500b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dae125a1-c3e3-4da9-8749-0312de61500b', 'volume_size': 1} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-734419541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dae125a1-c3e3-4da9-8749-0312de61500b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4a535f70a549e78a3d7a0a29b3f74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:33Z,use_quota=True,user_id='0a26d24a31c743d09472144974babb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Creating volume dae125a1-c3e3-4da9-8749-0312de61500b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:32 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:08:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:32 devstack sudo[91471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b 1073741824 Jul 06 21:08:32 devstack sudo[91471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:34 devstack sudo[91471]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b 1073741824" returned: 0 in 1.099s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:34 devstack sudo[91477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b Jul 06 21:08:34 devstack sudo[91477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:35 devstack sudo[91477]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b" returned: 0 in 0.948s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] <== create_volume: return (2106ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.109s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af76fe27-3cf4-44c1-a3a2-c011ca9a0185) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dae125a1-c3e3-4da9-8749-0312de61500b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f6682d-1702-43c3-99a1-9db43d71e0a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Volume volume-dae125a1-c3e3-4da9-8749-0312de61500b (dae125a1-c3e3-4da9-8749-0312de61500b): created successfully Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4f6682d-1702-43c3-99a1-9db43d71e0a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Flow 'volume_create_manager' (2c4a093d-ca07-402a-a4d6-fbf980d7ad9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-39963d11-340d-4041-8d06-30d20e0bc72d tempest-VolumesListAdminTestJSON-1004773519 None] Created volume successfully. Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Flow 'volume_create_manager' (25295ad3-d3be-4f3c-af61-4f24d16bade3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a477a19-b7a1-4f03-acf7-d09e1121f691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a477a19-b7a1-4f03-acf7-d09e1121f691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-191134913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f744a74-081c-4dce-877c-5a115df4447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c524c54a7f4cd3b65e6c1793a18e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:36Z,use_quota=True,user_id='7706c90ccf54467e84e9679f35148f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150f333-76af-49d6-b7e4-f77db7da5cef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4150f333-76af-49d6-b7e4-f77db7da5cef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437cb23f-6465-4403-8859-ca476016aa62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (437cb23f-6465-4403-8859-ca476016aa62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f744a74-081c-4dce-877c-5a115df4447e', 'volume_name': 'volume-1f744a74-081c-4dce-877c-5a115df4447e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32412e8-aaa5-488b-ba41-0ef8110fde8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c32412e8-aaa5-488b-ba41-0ef8110fde8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a661ed-66e9-4213-9f01-e710602dd9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Volume 1f744a74-081c-4dce-877c-5a115df4447e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f744a74-081c-4dce-877c-5a115df4447e', 'volume_size': 1} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-191134913',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f744a74-081c-4dce-877c-5a115df4447e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='45c524c54a7f4cd3b65e6c1793a18e75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:36Z,use_quota=True,user_id='7706c90ccf54467e84e9679f35148f31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Creating volume 1f744a74-081c-4dce-877c-5a115df4447e {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:35 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:08:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:35 devstack sudo[91499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e 1073741824 Jul 06 21:08:35 devstack sudo[91499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:36 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:36 devstack sudo[91499]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Flow 'volume_create_manager' (ca379521-06d1-4e01-9260-85cc045217b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a957dbf-b7a0-48e1-a460-197410ad3e3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e 1073741824" returned: 0 in 1.276s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2a957dbf-b7a0-48e1-a460-197410ad3e3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118814993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4a535f70a549e78a3d7a0a29b3f74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:37Z,use_quota=True,user_id='0a26d24a31c743d09472144974babb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfc306b-3040-4778-9b84-272544f8a36d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5bfc306b-3040-4778-9b84-272544f8a36d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4661d44-0cd0-4e32-b58b-da7f302d1254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4661d44-0cd0-4e32-b58b-da7f302d1254) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219', 'volume_name': 'volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab04c582-0b15-49ec-b8b5-83e7c71eab6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab04c582-0b15-49ec-b8b5-83e7c71eab6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66eef0a-a66d-4b58-922e-45775b46e8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:37 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Volume d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219', 'volume_size': 1} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:37 devstack sudo[91511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e Jul 06 21:08:37 devstack sudo[91511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:38 devstack sudo[91511]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e" returned: 0 in 1.067s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] <== create_volume: return (2454ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.460s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.106s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1118814993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1d4a535f70a549e78a3d7a0a29b3f74c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:37Z,use_quota=True,user_id='0a26d24a31c743d09472144974babb62',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Creating volume d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:38 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:38 devstack sudo[91568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 1073741824 Jul 06 21:08:38 devstack sudo[91568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12a661ed-66e9-4213-9f01-e710602dd9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f744a74-081c-4dce-877c-5a115df4447e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be52b1f5-02cc-43ab-afa5-97f2c1516cb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:38 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Volume volume-1f744a74-081c-4dce-877c-5a115df4447e (1f744a74-081c-4dce-877c-5a115df4447e): created successfully Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be52b1f5-02cc-43ab-afa5-97f2c1516cb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Flow 'volume_create_manager' (25295ad3-d3be-4f3c-af61-4f24d16bade3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4fea7780-a0f7-4e61-b07c-b10d7f7ca3a5 tempest-VolumesMetadataTest-1654389960 None] Created volume successfully. Jul 06 21:08:39 devstack sudo[91568]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 1073741824" returned: 0 in 1.202s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:39 devstack sudo[91602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 Jul 06 21:08:39 devstack sudo[91602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Acquiring lock "cinder-1f744a74-081c-4dce-877c-5a115df4447e-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Lock "cinder-1f744a74-081c-4dce-877c-5a115df4447e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Acquiring lock "cinder-quobyte-1f744a74-081c-4dce-877c-5a115df4447e" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Lock "cinder-quobyte-1f744a74-081c-4dce-877c-5a115df4447e" acquired by "delete_volume" :: waited 0.040s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4ff6e280-3784-4745-b1a8-8e28c30a7653]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:40 devstack sudo[91643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e Jul 06 21:08:40 devstack sudo[91643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:40 devstack sudo[91602]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219" returned: 0 in 1.400s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] <== create_volume: return (2666ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.677s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e66eef0a-a66d-4b58-922e-45775b46e8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a19f81-30a0-4d52-b002-e7e9841aff1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:40 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Volume volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 (d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219): created successfully Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c7a19f81-30a0-4d52-b002-e7e9841aff1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Flow 'volume_create_manager' (ca379521-06d1-4e01-9260-85cc045217b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:40 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a8a0c5ed-ce08-4489-acd3-439d0a164bd4 tempest-VolumesListAdminTestJSON-1004773519 None] Created volume successfully. Jul 06 21:08:41 devstack sudo[91643]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e" returned: 0 in 1.375s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:41 devstack sudo[91708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e Jul 06 21:08:41 devstack sudo[91708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Flow 'volume_create_manager' (937fb2d2-f532-4f5d-9e3c-58c8671fc8e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46982de-70ac-4f73-8335-2876e0d59be4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d46982de-70ac-4f73-8335-2876e0d59be4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac562b6c-9aca-425a-913f-862a96813aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76e709873ef44babe848a33a1c07d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:42Z,use_quota=True,user_id='63daece2f00b453d9609e65aa72dbd50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d1c62e-44a8-4db0-92e5-7def652840d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71d1c62e-44a8-4db0-92e5-7def652840d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b739cd-4ebb-4324-8f11-3f3670883b84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26b739cd-4ebb-4324-8f11-3f3670883b84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac562b6c-9aca-425a-913f-862a96813aad', 'volume_name': 'volume-ac562b6c-9aca-425a-913f-862a96813aad', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79822a77-db81-4deb-acfe-747bff270e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (79822a77-db81-4deb-acfe-747bff270e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226b2d4a-08f8-4859-a210-1e250a01b6c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:42 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Volume ac562b6c-9aca-425a-913f-862a96813aad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac562b6c-9aca-425a-913f-862a96813aad', 'volume_size': 1} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:42Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac562b6c-9aca-425a-913f-862a96813aad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a76e709873ef44babe848a33a1c07d7d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:42Z,use_quota=True,user_id='63daece2f00b453d9609e65aa72dbd50',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Creating volume ac562b6c-9aca-425a-913f-862a96813aad {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:42 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:42 devstack sudo[91710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad 1073741824 Jul 06 21:08:42 devstack sudo[91710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:42 devstack sudo[91708]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f744a74-081c-4dce-877c-5a115df4447e" returned: 0 in 1.299s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Lock "cinder-quobyte-1f744a74-081c-4dce-877c-5a115df4447e" released by "delete_volume" :: held 2.802s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Created reservations ['fabbaf2b-3ab2-4ea6-a1ec-8b14912881f3', 'e71074b9-9199-4bcf-bb8d-7bc38348383f', 'a63ba4e7-e2b5-4e7b-b34b-21b9bebea01a', 'a7353a3b-b0d0-4a63-bbac-3e49fdd8def2'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:43 devstack sudo[91736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:08:43 devstack sudo[91736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:44 devstack sudo[91710]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad 1073741824" returned: 0 in 2.180s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:44 devstack sudo[91762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad Jul 06 21:08:44 devstack sudo[91762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:45 devstack sudo[91736]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:45 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Deleted volume successfully. Jul 06 21:08:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f2357a23-3b65-4f24-81b8-effffcc3b841 tempest-VolumesMetadataTest-1654389960 None] Lock "cinder-1f744a74-081c-4dce-877c-5a115df4447e-delete_volume" released by "delete_volume" :: held 5.252s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:46 devstack sudo[91762]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad" returned: 0 in 1.985s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] <== create_volume: return (4242ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.245s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (226b2d4a-08f8-4859-a210-1e250a01b6c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac562b6c-9aca-425a-913f-862a96813aad', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7f3865-6a97-4a0a-9791-8a1449df00e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:46 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Volume volume-ac562b6c-9aca-425a-913f-862a96813aad (ac562b6c-9aca-425a-913f-862a96813aad): created successfully Jul 06 21:08:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d7f3865-6a97-4a0a-9791-8a1449df00e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Flow 'volume_create_manager' (937fb2d2-f532-4f5d-9e3c-58c8671fc8e9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-49f8b68c-505e-4038-b98c-0f74b41b40ae tempest-VolumesListAdminTestJSON-2124497313 None] Created volume successfully. Jul 06 21:08:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Acquiring lock "cinder-ac562b6c-9aca-425a-913f-862a96813aad-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Lock "cinder-ac562b6c-9aca-425a-913f-862a96813aad-delete_volume" acquired by "delete_volume" :: waited 0.083s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Acquiring lock "cinder-quobyte-ac562b6c-9aca-425a-913f-862a96813aad" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Lock "cinder-quobyte-ac562b6c-9aca-425a-913f-862a96813aad" acquired by "delete_volume" :: waited 0.047s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0fe8645-96db-48b0-8197-8686c6d4ebaa]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "cinder-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "cinder-quobyte-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-quobyte-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219" acquired by "delete_volume" :: waited 0.041s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf056fdc-548c-4e59-a5d8-fd3bcba49a2b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:48 devstack sudo[91772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad Jul 06 21:08:48 devstack sudo[91772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:48 devstack sudo[91773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 Jul 06 21:08:48 devstack sudo[91773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:50 devstack sudo[91773]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219" returned: 0 in 1.702s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:50 devstack sudo[91783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219 Jul 06 21:08:50 devstack sudo[91783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:50 devstack sudo[91772]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad" returned: 0 in 2.540s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:50 devstack sudo[91789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad Jul 06 21:08:50 devstack sudo[91789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Flow 'volume_create_manager' (5e9123a1-478e-441c-bba5-0965f1d87cd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17722068-69b3-4bf4-adf7-8192df8281df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17722068-69b3-4bf4-adf7-8192df8281df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-568266621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084c0040-c874-417c-a28b-64acc76622ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e324ed8fa3a4d3aada03deebf8d471c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:52Z,use_quota=True,user_id='e8292544f8f74960b9d675f06a9a8195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34aa8971-8d1a-4197-86f6-94f3e0968119) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34aa8971-8d1a-4197-86f6-94f3e0968119) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abab3ab-5cb7-44e0-b19a-5498640ac2a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9abab3ab-5cb7-44e0-b19a-5498640ac2a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '084c0040-c874-417c-a28b-64acc76622ed', 'volume_name': 'volume-084c0040-c874-417c-a28b-64acc76622ed', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a45f78-7712-4156-8900-a8c929f968d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8a45f78-7712-4156-8900-a8c929f968d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2de329b-154a-4efa-8834-14d24b74cbe7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:52 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Volume 084c0040-c874-417c-a28b-64acc76622ed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-084c0040-c874-417c-a28b-64acc76622ed', 'volume_size': 1} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-568266621',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=084c0040-c874-417c-a28b-64acc76622ed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e324ed8fa3a4d3aada03deebf8d471c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:08:52Z,use_quota=True,user_id='e8292544f8f74960b9d675f06a9a8195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Creating volume 084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:08:52 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:08:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:52 devstack sudo[91794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed 1073741824 Jul 06 21:08:52 devstack sudo[91794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:53 devstack sudo[91783]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219" returned: 0 in 2.610s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-quobyte-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219" released by "delete_volume" :: held 4.431s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:53 devstack sudo[91789]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac562b6c-9aca-425a-913f-862a96813aad" returned: 0 in 2.378s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Lock "cinder-quobyte-ac562b6c-9aca-425a-913f-862a96813aad" released by "delete_volume" :: held 5.049s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Created reservations ['deae04de-4049-4395-b03f-4caa517abd3d', '0fe1e35e-d09a-47af-8ca8-a2c6acd1ad0a', 'a255ab6b-9eea-4ee2-bde7-7bcb22be5e92', 'e9c3fff1-f467-40ba-bc8e-a73db54e74f9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:53 devstack sudo[91797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:08:53 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Created reservations ['bab71a98-1035-4c11-b0ef-e13ad9004147', '290b0a86-4f02-4bad-bced-e2b18bdc62fc', '6f9e4ac5-7183-432a-829e-f289327c78a1', '9f55eaab-0818-4e82-9f2a-0d89f28884e0'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:53 devstack sudo[91797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:54 devstack sudo[91802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:08:54 devstack sudo[91802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "cinder-dae125a1-c3e3-4da9-8749-0312de61500b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-dae125a1-c3e3-4da9-8749-0312de61500b-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:55 devstack sudo[91794]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed 1073741824" returned: 0 in 2.374s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "cinder-quobyte-dae125a1-c3e3-4da9-8749-0312de61500b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:08:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-quobyte-dae125a1-c3e3-4da9-8749-0312de61500b" acquired by "delete_volume" :: waited 0.184s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:08:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4a5c3af-67ea-4ae5-af51-d3f25c18cda0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:08:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:55 devstack sudo[91808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed Jul 06 21:08:55 devstack sudo[91808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:55 devstack sudo[91812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b Jul 06 21:08:55 devstack sudo[91812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:56 devstack sudo[91797]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 2.245s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Deleted volume successfully. Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bb798bd8-2d8f-41f0-a7c8-d9b8d9c07519 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-d5b7c8a7-e08a-4cb1-ab9f-f7d86f40c219-delete_volume" released by "delete_volume" :: held 7.607s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:56 devstack sudo[91802]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 2.231s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:08:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Deleted volume successfully. Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aab7c728-ee1f-4a95-a081-cd29c7538e5b tempest-VolumesListAdminTestJSON-2124497313 None] Lock "cinder-ac562b6c-9aca-425a-913f-862a96813aad-delete_volume" released by "delete_volume" :: held 8.509s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:56 devstack sudo[91812]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b" returned: 0 in 1.595s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:57 devstack sudo[91827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b Jul 06 21:08:57 devstack sudo[91827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:08:57 devstack sudo[91808]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed" returned: 0 in 1.909s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] <== create_volume: return (4506ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:08:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 4.509s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e2de329b-154a-4efa-8834-14d24b74cbe7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-084c0040-c874-417c-a28b-64acc76622ed', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ade095-31a3-4d7e-a4de-05a8ad84b410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:08:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Volume volume-084c0040-c874-417c-a28b-64acc76622ed (084c0040-c874-417c-a28b-64acc76622ed): created successfully Jul 06 21:08:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39ade095-31a3-4d7e-a4de-05a8ad84b410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:08:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Flow 'volume_create_manager' (5e9123a1-478e-441c-bba5-0965f1d87cd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:08:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2a2d1a6a-1810-44d5-8a4c-311f0c96c7de tempest-VolumesCloneTest-976739747 None] Created volume successfully. Jul 06 21:08:58 devstack sudo[91827]: pam_unix(sudo:session): session closed for user root Jul 06 21:08:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dae125a1-c3e3-4da9-8749-0312de61500b" returned: 0 in 1.854s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:08:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-quobyte-dae125a1-c3e3-4da9-8749-0312de61500b" released by "delete_volume" :: held 3.554s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:08:59 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Created reservations ['a797b0b6-856e-4a6c-8f69-59cb857dd940', 'c47a5f87-c5d3-49b3-8395-ddee70b6a14a', '7e652603-1359-4b60-bb50-243cbfc6d7a8', 'c4e742f5-c79e-4b22-98c3-ae3eaac6f045'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:08:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:08:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:08:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:08:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:08:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:08:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:08:59 devstack sudo[91847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:08:59 devstack sudo[91847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "cinder-21b50c94-8f76-49ec-a049-a942e83de728-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Flow 'volume_create_manager' (c9b114bc-4d2a-4aab-9353-e66ece140e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b129000-bdc9-4a5d-bdfa-4fe5d3bf4f5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-21b50c94-8f76-49ec-a049-a942e83de728-delete_volume" acquired by "delete_volume" :: waited 0.207s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b129000-bdc9-4a5d-bdfa-4fe5d3bf4f5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:08:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1665406351',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3e324ed8fa3a4d3aada03deebf8d471c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:00Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=084c0040-c874-417c-a28b-64acc76622ed,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:00Z,use_quota=True,user_id='e8292544f8f74960b9d675f06a9a8195',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03d1a66-7906-4fe1-9dd9-7badc660d716) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a03d1a66-7906-4fe1-9dd9-7badc660d716) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c105f8d-db2d-41c9-97be-ee07708e413e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c105f8d-db2d-41c9-97be-ee07708e413e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86', 'volume_name': 'volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86', 'volume_size': 2, 'source_volid': '084c0040-c874-417c-a28b-64acc76622ed', 'source_volstatus': 'available'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8e086e-c6c9-4816-ba83-f4c2bd0cdce9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bc8e086e-c6c9-4816-ba83-f4c2bd0cdce9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac8ecd-9758-4f0d-a7aa-ea173274709c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:00 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Volume 13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86', 'volume_size': 2, 'source_volid': '084c0040-c874-417c-a28b-64acc76622ed', 'source_volstatus': 'available'} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:00 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Cloning volume 084c0040-c874-417c-a28b-64acc76622ed to volume 13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "cinder-quobyte-21b50c94-8f76-49ec-a049-a942e83de728" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-quobyte-21b50c94-8f76-49ec-a049-a942e83de728" acquired by "delete_volume" :: waited 0.050s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Creating offline snapshot c69019a0-7452-45bb-9958-f0dcae76fef4 of volume 084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f9d4787-64bb-491b-aecc-d28ef6881bb1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a951c4f-24d3-4e46-a2ea-1a4ab805316c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:00 devstack sudo[91847]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.451s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Deleted volume successfully. Jul 06 21:09:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-50b770ba-b389-4ad5-8484-4336d10fdd01 tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-dae125a1-c3e3-4da9-8749-0312de61500b-delete_volume" released by "delete_volume" :: held 6.005s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:00 devstack sudo[91862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 Jul 06 21:09:00 devstack sudo[91862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:00 devstack sudo[91868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed Jul 06 21:09:00 devstack sudo[91868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:09:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:01 devstack sudo[91895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:01 devstack sudo[91895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:02 devstack sudo[91868]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed" returned: 0 in 1.418s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:02 devstack sudo[91928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 1G Jul 06 21:09:02 devstack sudo[91928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:02 devstack sudo[91862]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728" returned: 0 in 1.713s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:02 devstack sudo[91932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728 Jul 06 21:09:02 devstack sudo[91932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:02 devstack sudo[91895]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.430s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:09:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:09:03 devstack sudo[91932]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21b50c94-8f76-49ec-a049-a942e83de728" returned: 0 in 0.888s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-quobyte-21b50c94-8f76-49ec-a049-a942e83de728" released by "delete_volume" :: held 2.678s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:03 devstack sudo[91928]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 1G" returned: 0 in 1.235s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-084c0040-c874-417c-a28b-64acc76622ed -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Created reservations ['0ed8a928-567d-4e7d-bb04-6ee07374c5c9', 'dfa156f8-c187-4252-96bb-2e6349ae96cc', '833b6b18-fb3d-42ac-b3bc-566bcd034f00', '7896a19d-5342-4021-ad18-5645ec2e4d9d'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:03 devstack sudo[91961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-084c0040-c874-417c-a28b-64acc76622ed -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 Jul 06 21:09:03 devstack sudo[91961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:03 devstack sudo[91963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:03 devstack sudo[91963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:04 devstack sudo[91961]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-084c0040-c874-417c-a28b-64acc76622ed -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4" returned: 0 in 0.871s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:04 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 is being set with open permissions: ugo+rw Jul 06 21:09:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:04 devstack sudo[91970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 Jul 06 21:09:04 devstack sudo[91970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:04 devstack sudo[91963]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.291s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:04 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:04 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Deleted volume successfully. Jul 06 21:09:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8a247e9-c5e3-433f-95cf-7dde78dfa70f tempest-VolumesListAdminTestJSON-1004773519 None] Lock "cinder-21b50c94-8f76-49ec-a049-a942e83de728-delete_volume" released by "delete_volume" :: held 4.514s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:05 devstack sudo[91970]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4" returned: 0 in 1.469s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:05 devstack sudo[91975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.info Jul 06 21:09:05 devstack sudo[91975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Flow 'volume_create_manager' (46bb6759-46e8-4461-ba3f-fedb80128390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f558184-87f8-49c3-bbaa-a30603d43a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f558184-87f8-49c3-bbaa-a30603d43a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-448902344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e6ee86-0d59-495e-a8d8-a81e8576bda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfed6032195445579554a4f672efb340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:06Z,use_quota=True,user_id='12c2f5b57d714ea78ea7854ae9ea6d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5d1708-6b80-4b2f-a417-d37cfacac253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a5d1708-6b80-4b2f-a417-d37cfacac253) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fb4ec5-41bc-4980-a77b-fa24ab08439c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33fb4ec5-41bc-4980-a77b-fa24ab08439c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a1e6ee86-0d59-495e-a8d8-a81e8576bda5', 'volume_name': 'volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ae7eb1-3fe0-412f-b673-6ff789fba016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (17ae7eb1-3fe0-412f-b673-6ff789fba016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9082ddfd-8b2e-49a2-8dab-81ce97f87704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:05 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Volume a1e6ee86-0d59-495e-a8d8-a81e8576bda5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5', 'volume_size': 1} Jul 06 21:09:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:06 devstack sudo[91975]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.info" returned: 0 in 1.003s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:06 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.info is being set with open permissions: ugo+rw Jul 06 21:09:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:06 devstack sudo[91994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.info Jul 06 21:09:06 devstack sudo[91994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:07 devstack sudo[91994]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.info" returned: 0 in 1.281s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Acquiring lock "cinder-quobyte-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" acquired by "_copy_volume_from_snapshot" :: waited 0.043s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] snapshot: c69019a0-7452-45bb-9958-f0dcae76fef4, volume: 13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f904f9e-22c3-4f6d-9a53-5e0b6722b69b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:08 devstack sudo[92014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 Jul 06 21:09:08 devstack sudo[92014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:09 devstack sudo[92014]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4" returned: 0 in 1.506s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-084c0040-c874-417c-a28b-64acc76622ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:09:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:09:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:09:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b16524-1c08-4ea2-a10d-bcd68153d597]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:09 devstack sudo[92031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed Jul 06 21:09:09 devstack sudo[92031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:11 devstack sudo[92031]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed" returned: 0 in 1.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:11 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:09:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:11 devstack sudo[92038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 Jul 06 21:09:11 devstack sudo[92038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:15 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=41,cinder:INSERT=11,cinder:UPDATE=59,cinder:DELETE=8 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:09:15 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=43,cinder:UPDATE=60,cinder:DELETE=3,cinder:INSERT=17 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Flow 'volume_create_manager' (1c1d86dc-7e9b-4551-ba58-58dba5a17a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88affb48-e6c6-4173-be99-40994ab32537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88affb48-e6c6-4173-be99-40994ab32537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1476876942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b78a2de-9b4b-46e7-a84e-3cb9d327d105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f13a6ab914b998b872b6a201f7f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:17Z,use_quota=True,user_id='4fca1ad659d94724a0a9efe0eca6f19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3caca52-8ba4-4150-bbe3-cfb002316aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3caca52-8ba4-4150-bbe3-cfb002316aef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a564f66-9154-4d30-be8a-ce421410bfa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a564f66-9154-4d30-be8a-ce421410bfa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2b78a2de-9b4b-46e7-a84e-3cb9d327d105', 'volume_name': 'volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b955bd-63e3-4d98-aac3-672739434b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0b955bd-63e3-4d98-aac3-672739434b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d775a8aa-8a6b-4cee-b73c-2b3680414032) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:17 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Volume 2b78a2de-9b4b-46e7-a84e-3cb9d327d105: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105', 'volume_size': 1} Jul 06 21:09:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:19 devstack sudo[92038]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" returned: 0 in 8.473s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:19 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc4694bf-6e26-4d2e-a123-4174b2a9daf3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:20 devstack sudo[92107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed Jul 06 21:09:20 devstack sudo[92107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:20 devstack sudo[92107]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed" returned: 0 in 0.890s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:20 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed, size 1024.00 MB, duration 8.47 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:09:20 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Converted 1024.00 MB image at 120.84 MB/s Jul 06 21:09:20 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 is being set with open permissions: ugo+rw Jul 06 21:09:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:20 devstack sudo[92112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 Jul 06 21:09:20 devstack sudo[92112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:21 devstack sudo[92112]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" returned: 0 in 0.673s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" released by "_copy_volume_from_snapshot" :: held 13.408s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Acquiring lock "cinder-quobyte-c69019a0-7452-45bb-9958-f0dcae76fef4" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-c69019a0-7452-45bb-9958-f0dcae76fef4" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Deleting offline snapshot c69019a0-7452-45bb-9958-f0dcae76fef4 of volume 084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] snapshot_file for this snap is: volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[daceefb2-684b-42aa-96cf-4f8abdd76f75]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:21 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 Jul 06 21:09:21 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:22 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4" returned: 0 in 0.726s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-084c0040-c874-417c-a28b-64acc76622ed(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:09:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[90c280c5-9489-45a3-b2e0-e9e2ff95ac6c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:22 devstack sudo[92120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed Jul 06 21:09:22 devstack sudo[92120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:22 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Flow 'volume_create_manager' (12bd1652-4e3a-4ffc-9b27-105cbde8fd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddedf873-2157-4643-a149-2231370acb9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddedf873-2157-4643-a149-2231370acb9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1779235276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88b04a2-6ae1-4a4c-962a-ea815e098e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2ac8f3158f49148e4e6aec87c05cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:23Z,use_quota=True,user_id='43594abfea6f47a69568ae803d428380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd66ab5-97bc-4875-80bf-2dfbd8bdcfeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddd66ab5-97bc-4875-80bf-2dfbd8bdcfeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360842bd-cdf2-4baf-8815-7caebc333c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (360842bd-cdf2-4baf-8815-7caebc333c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f88b04a2-6ae1-4a4c-962a-ea815e098e94', 'volume_name': 'volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb86cb33-eaac-4142-b0d4-6c95603b98fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb86cb33-eaac-4142-b0d4-6c95603b98fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:23 devstack sudo[92120]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee5d627-e2b5-44ce-9f2e-3037db4814cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Volume f88b04a2-6ae1-4a4c-962a-ea815e098e94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94', 'volume_size': 1} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed" returned: 0 in 0.791s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:23 devstack sudo[92125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 Jul 06 21:09:23 devstack sudo[92125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:23 devstack sudo[92125]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4" returned: 0 in 0.747s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:23 devstack sudo[92130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4 Jul 06 21:09:23 devstack sudo[92130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:24 devstack sudo[92130]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed.c69019a0-7452-45bb-9958-f0dcae76fef4" returned: 0 in 0.703s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-c69019a0-7452-45bb-9958-f0dcae76fef4" released by "_delete_snapshot" :: held 3.058s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 24.115s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.714s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-448902344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a1e6ee86-0d59-495e-a8d8-a81e8576bda5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cfed6032195445579554a4f672efb340',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:06Z,use_quota=True,user_id='12c2f5b57d714ea78ea7854ae9ea6d99',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Creating volume a1e6ee86-0d59-495e-a8d8-a81e8576bda5 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:24 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:24 devstack sudo[92133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 1073741824 Jul 06 21:09:24 devstack sudo[92133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0ac8ecd-9758-4f0d-a7aa-ea173274709c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86', 'volume_size': 2, 'source_volid': '084c0040-c874-417c-a28b-64acc76622ed', 'source_volstatus': 'available'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3b74f9-449d-410b-99e9-7d273bd8d4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:24 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Volume volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 (13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86): created successfully Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd3b74f9-449d-410b-99e9-7d273bd8d4fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Flow 'volume_create_manager' (c9b114bc-4d2a-4aab-9353-e66ece140e61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2d11d8fd-a1c1-4b64-91cd-1d5f4580f1f7 tempest-VolumesCloneTest-976739747 None] Created volume successfully. Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Acquiring lock "cinder-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Lock "cinder-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Acquiring lock "cinder-quobyte-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d126b98-da98-4f10-8e57-b58767609748]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:25 devstack sudo[92133]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 1073741824" returned: 0 in 0.932s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:25 devstack sudo[92139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 Jul 06 21:09:25 devstack sudo[92139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:25 devstack sudo[92141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 Jul 06 21:09:25 devstack sudo[92141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:26 devstack sudo[92139]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:26 devstack sudo[92141]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5" returned: 0 in 0.651s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] <== create_volume: return (1631ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.634s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.211s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1476876942',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b78a2de-9b4b-46e7-a84e-3cb9d327d105,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='293f13a6ab914b998b872b6a201f7f66',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:17Z,use_quota=True,user_id='4fca1ad659d94724a0a9efe0eca6f19c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Creating volume 2b78a2de-9b4b-46e7-a84e-3cb9d327d105 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:26 devstack sudo[92147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86 Jul 06 21:09:26 devstack sudo[92147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:26 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9082ddfd-8b2e-49a2-8dab-81ce97f87704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508170ff-48e2-4e86-abe5-b4d6f406854c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:26 devstack sudo[92149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 1073741824 Jul 06 21:09:26 devstack sudo[92149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:26 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Volume volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 (a1e6ee86-0d59-495e-a8d8-a81e8576bda5): created successfully Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (508170ff-48e2-4e86-abe5-b4d6f406854c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Flow 'volume_create_manager' (46bb6759-46e8-4461-ba3f-fedb80128390) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2a9d597a-d1fd-45c8-b14d-013c89a2f54b tempest-ServerRescueNegativeTestJSON-1134017934 None] Created volume successfully. Jul 06 21:09:27 devstack sudo[92147]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" returned: 0 in 0.901s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86" released by "delete_volume" :: held 1.717s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Created reservations ['375ba2de-09d4-4d79-862f-4e8f44cea205', '125e13d8-f3cc-494e-810e-b522d9647dd2', 'f49f6bbc-384c-4396-adfc-cbdf1a8b3b5e', '93504265-8416-4f0b-a662-9131b7440c75'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:27 devstack sudo[92156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:27 devstack sudo[92156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:27 devstack sudo[92149]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 1073741824" returned: 0 in 1.086s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:27 devstack sudo[92158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 Jul 06 21:09:27 devstack sudo[92158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Acquiring lock "cinder-084c0040-c874-417c-a28b-64acc76622ed-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Lock "cinder-084c0040-c874-417c-a28b-64acc76622ed-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Acquiring lock "cinder-quobyte-084c0040-c874-417c-a28b-64acc76622ed" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-084c0040-c874-417c-a28b-64acc76622ed" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7f22767-622f-436c-9cc6-7a3f49eb5793]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:27 devstack sudo[92160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed Jul 06 21:09:27 devstack sudo[92160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:28 devstack sudo[92156]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.998s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Deleted volume successfully. Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fd313940-a784-411e-842c-54dcf4d36073 tempest-VolumesCloneTest-976739747 None] Lock "cinder-13e15a85-fb0f-4a3d-b57d-a3d65f2c0a86-delete_volume" released by "delete_volume" :: held 2.983s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:28 devstack sudo[92158]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105" returned: 0 in 0.987s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] <== create_volume: return (2130ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.134s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.304s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1779235276',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f88b04a2-6ae1-4a4c-962a-ea815e098e94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2ac8f3158f49148e4e6aec87c05cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:23Z,use_quota=True,user_id='43594abfea6f47a69568ae803d428380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Creating volume f88b04a2-6ae1-4a4c-962a-ea815e098e94 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:28 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:28 devstack sudo[92165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 1073741824 Jul 06 21:09:28 devstack sudo[92165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d775a8aa-8a6b-4cee-b73c-2b3680414032) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0601e54a-dec1-446d-a085-a9cd5135d78c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Volume volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 (2b78a2de-9b4b-46e7-a84e-3cb9d327d105): created successfully Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0601e54a-dec1-446d-a085-a9cd5135d78c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Flow 'volume_create_manager' (1c1d86dc-7e9b-4551-ba58-58dba5a17a85) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f2c7643b-8ff7-4be1-bc6a-36f03d133b7d tempest-AbsoluteLimitsTests-105699435 None] Created volume successfully. Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Acquiring lock "cinder-2b78a2de-9b4b-46e7-a84e-3cb9d327d105-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Lock "cinder-2b78a2de-9b4b-46e7-a84e-3cb9d327d105-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Acquiring lock "cinder-quobyte-2b78a2de-9b4b-46e7-a84e-3cb9d327d105" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Lock "cinder-quobyte-2b78a2de-9b4b-46e7-a84e-3cb9d327d105" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e61f25-8526-4cbb-8aed-81da10750411]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:29 devstack sudo[92160]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed" returned: 0 in 1.223s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:29 devstack sudo[92171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed Jul 06 21:09:29 devstack sudo[92171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:29 devstack sudo[92170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 Jul 06 21:09:29 devstack sudo[92170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:29 devstack sudo[92165]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 1073741824" returned: 0 in 1.132s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:29 devstack sudo[92178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 Jul 06 21:09:29 devstack sudo[92178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:29 devstack sudo[92171]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-084c0040-c874-417c-a28b-64acc76622ed" returned: 0 in 0.785s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Lock "cinder-quobyte-084c0040-c874-417c-a28b-64acc76622ed" released by "delete_volume" :: held 2.089s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:29 devstack sudo[92170]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105" returned: 0 in 0.858s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:29 devstack sudo[92184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105 Jul 06 21:09:29 devstack sudo[92184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:29 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Created reservations ['0b678531-409c-49cf-97b6-e582b1414973', '8275e290-1818-4c85-8580-8ab3b5ff4c74', 'c659cbd7-3ed5-40c2-8ca3-1debf58b0f2e', 'f2a056e7-faa2-40cc-9946-35fbeacd230b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:30 devstack sudo[92186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:30 devstack sudo[92186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:30 devstack sudo[92178]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94" returned: 0 in 0.765s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] <== create_volume: return (1958ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.962s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ee5d627-e2b5-44ce-9f2e-3037db4814cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03004d6-1c33-4703-86b5-d765e8a9b7c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Volume volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 (f88b04a2-6ae1-4a4c-962a-ea815e098e94): created successfully Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f03004d6-1c33-4703-86b5-d765e8a9b7c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Flow 'volume_create_manager' (12bd1652-4e3a-4ffc-9b27-105cbde8fd9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2011a3a1-79a5-4ba7-82a0-b9e539d3ca71 tempest-ServersNegativeTestJSON-210195075 None] Created volume successfully. Jul 06 21:09:30 devstack sudo[92184]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2b78a2de-9b4b-46e7-a84e-3cb9d327d105" returned: 0 in 0.695s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Lock "cinder-quobyte-2b78a2de-9b4b-46e7-a84e-3cb9d327d105" released by "delete_volume" :: held 1.629s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Created reservations ['970a3d51-030c-491d-9d44-d6b446d91009', '3b69dafb-9db9-4465-a02f-44d6f32fa432', 'e652eba7-b7e3-4cd4-8952-2e9880c8bbd5', '37d4cee3-cd8c-4a58-8208-7df5c3dd89d3'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:30 devstack sudo[92193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:30 devstack sudo[92193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:30 devstack sudo[92186]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.790s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Deleted volume successfully. Jul 06 21:09:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b0a5166b-a60c-4326-824f-e8192b891906 tempest-VolumesCloneTest-976739747 None] Lock "cinder-084c0040-c874-417c-a28b-64acc76622ed-delete_volume" released by "delete_volume" :: held 3.191s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:31 devstack sudo[92193]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.707s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:31 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Deleted volume successfully. Jul 06 21:09:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-489d0100-d7c5-4ee6-a6f8-c18a07fb7bb0 tempest-AbsoluteLimitsTests-105699435 None] Lock "cinder-2b78a2de-9b4b-46e7-a84e-3cb9d327d105-delete_volume" released by "delete_volume" :: held 2.589s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:33 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Flow 'volume_create_manager' (2fe70427-4057-4fa0-afa0-2078a7eca46b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df2be56-b142-4856-8caa-31827c23ffda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8df2be56-b142-4856-8caa-31827c23ffda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-454996079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ca77f0-1ecf-40b1-b9e2-38c4991c320b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2ac8f3158f49148e4e6aec87c05cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:34Z,use_quota=True,user_id='43594abfea6f47a69568ae803d428380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8648df59-24d2-42e1-ae40-e55c9dcb0ea6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8648df59-24d2-42e1-ae40-e55c9dcb0ea6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f63955-e9e4-421b-8800-c3be1dfb6b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21f63955-e9e4-421b-8800-c3be1dfb6b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '11ca77f0-1ecf-40b1-b9e2-38c4991c320b', 'volume_name': 'volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44231439-1ab3-4a29-84f3-dcfae7fa19a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (44231439-1ab3-4a29-84f3-dcfae7fa19a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72165eb6-ffd0-42d6-8ac0-786b042c0ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:34 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Volume 11ca77f0-1ecf-40b1-b9e2-38c4991c320b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b', 'volume_size': 1} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-454996079',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=11ca77f0-1ecf-40b1-b9e2-38c4991c320b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0d2ac8f3158f49148e4e6aec87c05cd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:34Z,use_quota=True,user_id='43594abfea6f47a69568ae803d428380',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Creating volume 11ca77f0-1ecf-40b1-b9e2-38c4991c320b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:34 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:34 devstack sudo[92207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b 1073741824 Jul 06 21:09:34 devstack sudo[92207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:35 devstack sudo[92207]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b 1073741824" returned: 0 in 1.390s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:35 devstack sudo[92219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b Jul 06 21:09:35 devstack sudo[92219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:36 devstack sudo[92219]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b" returned: 0 in 0.906s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] <== create_volume: return (2345ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.348s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72165eb6-ffd0-42d6-8ac0-786b042c0ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99bf29d-6f2e-4700-bb3a-7ae96aca8980) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:36 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Volume volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b (11ca77f0-1ecf-40b1-b9e2-38c4991c320b): created successfully Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b99bf29d-6f2e-4700-bb3a-7ae96aca8980) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Flow 'volume_create_manager' (2fe70427-4057-4fa0-afa0-2078a7eca46b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0e421414-25c1-4c1f-b522-667766f20c71 tempest-ServersNegativeTestJSON-210195075 None] Created volume successfully. Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Flow 'volume_create_manager' (91030203-fabe-489e-a7e9-e7ea6b34d6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e120e2-2ede-43e4-adc4-cfc9c2805a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23e120e2-2ede-43e4-adc4-cfc9c2805a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-609780183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b03134-7b0b-486d-94eb-78c737ec66b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a65553c48b8485c9045aa004962f739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:37Z,use_quota=True,user_id='4345a20e1dc84b579d55768be9e71e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63347d2-2177-45af-a4f2-8469d4b4513a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e63347d2-2177-45af-a4f2-8469d4b4513a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6588c68-0c00-4373-8153-66ce765d891b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6588c68-0c00-4373-8153-66ce765d891b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03b03134-7b0b-486d-94eb-78c737ec66b9', 'volume_name': 'volume-03b03134-7b0b-486d-94eb-78c737ec66b9', 'volume_size': 2}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1885278c-72e9-4f07-8bd1-01609f63d6e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1885278c-72e9-4f07-8bd1-01609f63d6e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaeb122-8676-4c31-86f5-fcc8f9b5237d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:36 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Volume 03b03134-7b0b-486d-94eb-78c737ec66b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03b03134-7b0b-486d-94eb-78c737ec66b9', 'volume_size': 2} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-609780183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03b03134-7b0b-486d-94eb-78c737ec66b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2a65553c48b8485c9045aa004962f739',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:37Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:37Z,use_quota=True,user_id='4345a20e1dc84b579d55768be9e71e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Creating volume 03b03134-7b0b-486d-94eb-78c737ec66b9 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:36 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 2147483648 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:36 devstack sudo[92271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 2147483648 Jul 06 21:09:36 devstack sudo[92271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "cinder-11ca77f0-1ecf-40b1-b9e2-38c4991c320b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-11ca77f0-1ecf-40b1-b9e2-38c4991c320b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "cinder-quobyte-11ca77f0-1ecf-40b1-b9e2-38c4991c320b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-quobyte-11ca77f0-1ecf-40b1-b9e2-38c4991c320b" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ee972d-986c-49fc-917b-085512b508fe]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:38 devstack sudo[92287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b Jul 06 21:09:38 devstack sudo[92287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:38 devstack sudo[92271]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 2147483648" returned: 0 in 1.856s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:38 devstack sudo[92290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 Jul 06 21:09:38 devstack sudo[92290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:39 devstack sudo[92287]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b" returned: 0 in 1.457s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:39 devstack sudo[92296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b Jul 06 21:09:39 devstack sudo[92296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:39 devstack sudo[92290]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9" returned: 0 in 0.943s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] <== create_volume: return (2881ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.887s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8aaeb122-8676-4c31-86f5-fcc8f9b5237d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03b03134-7b0b-486d-94eb-78c737ec66b9', 'volume_size': 2}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbaa316-2df9-490f-9b02-a4fc0ff3207f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:39 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Volume volume-03b03134-7b0b-486d-94eb-78c737ec66b9 (03b03134-7b0b-486d-94eb-78c737ec66b9): created successfully Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecbaa316-2df9-490f-9b02-a4fc0ff3207f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Flow 'volume_create_manager' (91030203-fabe-489e-a7e9-e7ea6b34d6a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-329be4b9-06f8-4b50-9fe4-a008bf096857 tempest-VolumesCloneNegativeTest-6683064 None] Created volume successfully. Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Flow 'volume_create_manager' (6e0d3263-ac93-4526-a51b-68a2e33b75a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a81525b-b3ec-4256-a326-aa256587a764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a81525b-b3ec-4256-a326-aa256587a764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-157998447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5fa952-12f4-49b4-b169-091ab4dbd753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b3c29efad44073836f0ca40546bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:40Z,use_quota=True,user_id='d1965a8d139a4795a4ff8b7c8dd51b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae4542b-3313-4db5-aea1-4afbba8be4d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ae4542b-3313-4db5-aea1-4afbba8be4d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9991a6-f7cc-4601-ac28-1ee5dc2e151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d9991a6-f7cc-4601-ac28-1ee5dc2e151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6c5fa952-12f4-49b4-b169-091ab4dbd753', 'volume_name': 'volume-6c5fa952-12f4-49b4-b169-091ab4dbd753', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df92b0b-ca6c-4129-8c6c-40c9d64cb333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df92b0b-ca6c-4129-8c6c-40c9d64cb333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b647064-b014-456f-90a0-5ed162636383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:40 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Volume 6c5fa952-12f4-49b4-b169-091ab4dbd753: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6c5fa952-12f4-49b4-b169-091ab4dbd753', 'volume_size': 1} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-157998447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c5fa952-12f4-49b4-b169-091ab4dbd753,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b3c29efad44073836f0ca40546bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:40Z,use_quota=True,user_id='d1965a8d139a4795a4ff8b7c8dd51b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Creating volume 6c5fa952-12f4-49b4-b169-091ab4dbd753 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:40 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:40 devstack sudo[92298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 1073741824 Jul 06 21:09:40 devstack sudo[92298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:40 devstack sudo[92296]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-11ca77f0-1ecf-40b1-b9e2-38c4991c320b" returned: 0 in 0.981s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-quobyte-11ca77f0-1ecf-40b1-b9e2-38c4991c320b" released by "delete_volume" :: held 2.500s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Created reservations ['2e1a5d36-e249-490a-9d85-5afc22cf5d03', '0c6533dc-e331-434b-b239-03ebe6596742', 'faf75f3a-bdfb-4b0c-8b7e-f6c5cfe7e974', '4ebf781c-5034-43e7-a2cb-ca6d8f60d905'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:40 devstack sudo[92301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:40 devstack sudo[92301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Acquiring lock "cinder-03b03134-7b0b-486d-94eb-78c737ec66b9-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Lock "cinder-03b03134-7b0b-486d-94eb-78c737ec66b9-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Acquiring lock "cinder-quobyte-03b03134-7b0b-486d-94eb-78c737ec66b9" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Lock "cinder-quobyte-03b03134-7b0b-486d-94eb-78c737ec66b9" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ccb65b2-9952-4fb7-be52-b97be10a5b5a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:41 devstack sudo[92298]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 1073741824" returned: 0 in 1.090s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:41 devstack sudo[92301]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:41 devstack sudo[92307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:41 devstack sudo[92307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Deleted volume successfully. Jul 06 21:09:41 devstack sudo[92324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 Jul 06 21:09:41 devstack sudo[92324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-08865b85-654b-44ba-90c7-cf3a5bf50611 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-11ca77f0-1ecf-40b1-b9e2-38c4991c320b-delete_volume" released by "delete_volume" :: held 3.607s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "cinder-f88b04a2-6ae1-4a4c-962a-ea815e098e94-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-f88b04a2-6ae1-4a4c-962a-ea815e098e94-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "cinder-quobyte-f88b04a2-6ae1-4a4c-962a-ea815e098e94" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-quobyte-f88b04a2-6ae1-4a4c-962a-ea815e098e94" acquired by "delete_volume" :: waited 0.036s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8262ead0-dd00-4f0d-a661-4cec202f62ee]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:42 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 Jul 06 21:09:42 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:42 devstack sudo[92307]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9" returned: 0 in 0.988s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:42 devstack sudo[92365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9 Jul 06 21:09:42 devstack sudo[92365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:42 devstack sudo[92324]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753" returned: 0 in 1.002s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] <== create_volume: return (2188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.199s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b647064-b014-456f-90a0-5ed162636383) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c5fa952-12f4-49b4-b169-091ab4dbd753', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e36da0e-b556-499f-acba-8d78bb49c3a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:42 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Volume volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 (6c5fa952-12f4-49b4-b169-091ab4dbd753): created successfully Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7e36da0e-b556-499f-acba-8d78bb49c3a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Flow 'volume_create_manager' (6e0d3263-ac93-4526-a51b-68a2e33b75a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d9e4cede-9d08-4fb1-b864-bcc59b62560e tempest-VolumesTransfersTest-1946037555 None] Created volume successfully. Jul 06 21:09:42 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94" returned: 0 in 1.039s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:42 devstack sudo[92386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94 Jul 06 21:09:42 devstack sudo[92386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:43 devstack sudo[92365]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-03b03134-7b0b-486d-94eb-78c737ec66b9" returned: 0 in 0.763s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Lock "cinder-quobyte-03b03134-7b0b-486d-94eb-78c737ec66b9" released by "delete_volume" :: held 1.803s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Created reservations ['9bf8ab4c-e2fc-4724-815d-cc95622aa8fa', 'dd00897d-a65e-456e-95e7-e14de55e4947', 'ebd7c433-2232-41e5-8ab4-913263b7c61b', 'd3595bc8-cc55-4b6c-897e-ded193c92044'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:43 devstack sudo[92389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:43 devstack sudo[92389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:43 devstack sudo[92386]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f88b04a2-6ae1-4a4c-962a-ea815e098e94" returned: 0 in 1.014s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-quobyte-f88b04a2-6ae1-4a4c-962a-ea815e098e94" released by "delete_volume" :: held 2.121s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Created reservations ['5b539a74-daa7-4da1-a75e-c0567184dd42', '156e2897-3868-455b-adde-5a73be82c2cb', 'c9b03391-8f20-40af-902d-5a5ea36bc98b', '18f98b60-387e-4a1f-bdf2-2895897569e6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:44 devstack sudo[92394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:44 devstack sudo[92394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:44 devstack sudo[92389]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.115s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Deleted volume successfully. Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e620f97-f317-4474-9317-ca2833544462 tempest-VolumesCloneNegativeTest-6683064 None] Lock "cinder-03b03134-7b0b-486d-94eb-78c737ec66b9-delete_volume" released by "delete_volume" :: held 3.302s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1caf6bdf-9a97-4fc5-878a-df1dd494bd96 tempest-VolumesTransfersTest-1946327920 None] Transfer volume completed successfully. Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Acquiring lock "cinder-a1e6ee86-0d59-495e-a8d8-a81e8576bda5-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "cinder-a1e6ee86-0d59-495e-a8d8-a81e8576bda5-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Acquiring lock "cinder-quobyte-a1e6ee86-0d59-495e-a8d8-a81e8576bda5" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "cinder-quobyte-a1e6ee86-0d59-495e-a8d8-a81e8576bda5" acquired by "delete_volume" :: waited 0.039s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa43ab5-123d-4c5b-9ec5-a1c8fd7d6f8a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:45 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 Jul 06 21:09:45 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:45 devstack sudo[92394]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.622s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:45 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Deleted volume successfully. Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d8dd6d78-b1d4-42c7-be43-940ed56ee2f2 tempest-ServersNegativeTestJSON-210195075 None] Lock "cinder-f88b04a2-6ae1-4a4c-962a-ea815e098e94-delete_volume" released by "delete_volume" :: held 4.291s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:46 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Acquiring lock "cinder-6c5fa952-12f4-49b4-b169-091ab4dbd753-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5" returned: 0 in 1.461s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-6c5fa952-12f4-49b4-b169-091ab4dbd753-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:46 devstack sudo[92404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5 Jul 06 21:09:46 devstack sudo[92404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Acquiring lock "cinder-quobyte-6c5fa952-12f4-49b4-b169-091ab4dbd753" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-quobyte-6c5fa952-12f4-49b4-b169-091ab4dbd753" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[62cca487-a016-4bf2-9b01-b46f14165e07]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:46 devstack sudo[92407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 Jul 06 21:09:46 devstack sudo[92407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:47 devstack sudo[92404]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a1e6ee86-0d59-495e-a8d8-a81e8576bda5" returned: 0 in 1.363s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "cinder-quobyte-a1e6ee86-0d59-495e-a8d8-a81e8576bda5" released by "delete_volume" :: held 2.911s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Created reservations ['894319e7-aea5-4dcf-a650-2a4c8bc30f4e', 'e88a3bf0-87cb-49fa-b3a0-27b39bb92ffa', '23446fc0-12d1-448e-948b-f7670800c9bd', '8df35f91-5ff8-4833-b594-da1c7adc9083'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:48 devstack sudo[92407]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753" returned: 0 in 1.308s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:48 devstack sudo[92434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753 Jul 06 21:09:48 devstack sudo[92434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:48 devstack sudo[92438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:48 devstack sudo[92438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:49 devstack sudo[92434]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6c5fa952-12f4-49b4-b169-091ab4dbd753" returned: 0 in 1.440s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-quobyte-6c5fa952-12f4-49b4-b169-091ab4dbd753" released by "delete_volume" :: held 2.852s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Created reservations ['92c3a593-95bc-497e-9607-d96611c827e5', '968b71f2-6212-43a3-b9de-17838fd7daec', 'eb4cda4e-6187-426a-a9c9-e64586a26307', 'fc9171c9-4843-4b74-8bcf-3fa7931efa08'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Flow 'volume_create_manager' (fab980c2-85a1-4d0f-b907-16ade213c2d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747d7578-c525-4234-af15-c2ad253497b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (747d7578-c525-4234-af15-c2ad253497b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2131761716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cbcdae-49d1-4293-b872-eed563083c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2000512aa5a0413ca4a16ca7319e6ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:50Z,use_quota=True,user_id='12afcf434e1a4cf394884fc9784b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9809af78-3d5e-4d2e-84b8-9b4f9a05ef8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9809af78-3d5e-4d2e-84b8-9b4f9a05ef8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2544c890-1919-416d-9470-dc3948035271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2544c890-1919-416d-9470-dc3948035271) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26cbcdae-49d1-4293-b872-eed563083c52', 'volume_name': 'volume-26cbcdae-49d1-4293-b872-eed563083c52', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:49 devstack sudo[92438]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa87a1-9fe3-4d9c-ab86-274cd434691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08fa87a1-9fe3-4d9c-ab86-274cd434691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9985e75-3e0f-480e-b50e-0228ac8fb601) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:50 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Volume 26cbcdae-49d1-4293-b872-eed563083c52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26cbcdae-49d1-4293-b872-eed563083c52', 'volume_size': 1} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-2131761716',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26cbcdae-49d1-4293-b872-eed563083c52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2000512aa5a0413ca4a16ca7319e6ffa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:50Z,use_quota=True,user_id='12afcf434e1a4cf394884fc9784b610c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Creating volume 26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:50 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:50 devstack sudo[92445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 1073741824 Jul 06 21:09:50 devstack sudo[92445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Deleted volume successfully. Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-835767ac-d346-43ae-994d-a2f81db98a4e tempest-ServerRescueNegativeTestJSON-1134017934 None] Lock "cinder-a1e6ee86-0d59-495e-a8d8-a81e8576bda5-delete_volume" released by "delete_volume" :: held 5.129s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:50 devstack sudo[92447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:50 devstack sudo[92447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:51 devstack sudo[92447]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.406s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Deleted volume successfully. Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7c6ec122-6d68-490a-bb9f-87d9b11d6819 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-6c5fa952-12f4-49b4-b169-091ab4dbd753-delete_volume" released by "delete_volume" :: held 5.013s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Flow 'volume_create_manager' (f3020361-8dd0-4e50-96ba-2da4c0afd1bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37127ddc-3ab5-4421-b6c7-f9ebd1fe0877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (37127ddc-3ab5-4421-b6c7-f9ebd1fe0877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2015893170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993f9433-b3ec-44a4-87ac-bced47aa4cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b3c29efad44073836f0ca40546bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:52Z,use_quota=True,user_id='d1965a8d139a4795a4ff8b7c8dd51b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68235773-980b-4121-9828-708fa8a6dd37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68235773-980b-4121-9828-708fa8a6dd37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d869335-8d9f-4236-8a49-b3fb71220e89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d869335-8d9f-4236-8a49-b3fb71220e89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '993f9433-b3ec-44a4-87ac-bced47aa4cb3', 'volume_name': 'volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d20ff2-abf7-49d9-90cb-434ffc272871) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88d20ff2-abf7-49d9-90cb-434ffc272871) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7686cd-c831-46d1-8997-f7387ee0684a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:51 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Volume 993f9433-b3ec-44a4-87ac-bced47aa4cb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3', 'volume_size': 1} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:51 devstack sudo[92445]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 1073741824" returned: 0 in 1.801s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:51 devstack sudo[92479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 Jul 06 21:09:51 devstack sudo[92479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:52 devstack sudo[92479]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52" returned: 0 in 0.870s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] <== create_volume: return (2748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.750s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-2015893170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=993f9433-b3ec-44a4-87ac-bced47aa4cb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='55b3c29efad44073836f0ca40546bd36',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:09:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:09:52Z,use_quota=True,user_id='d1965a8d139a4795a4ff8b7c8dd51b20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Creating volume 993f9433-b3ec-44a4-87ac-bced47aa4cb3 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:09:52 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9985e75-3e0f-480e-b50e-0228ac8fb601) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26cbcdae-49d1-4293-b872-eed563083c52', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:52 devstack sudo[92485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 1073741824 Jul 06 21:09:52 devstack sudo[92485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7d6f0-c79a-40f8-a90c-745d7891db34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:52 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Volume volume-26cbcdae-49d1-4293-b872-eed563083c52 (26cbcdae-49d1-4293-b872-eed563083c52): created successfully Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e5c7d6f0-c79a-40f8-a90c-745d7891db34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Flow 'volume_create_manager' (fab980c2-85a1-4d0f-b907-16ade213c2d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:52 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4f19b27e-99c5-48f2-aec5-6d161cf6af8a tempest-VolumesSnapshotListTestJSON-1192179619 None] Created volume successfully. Jul 06 21:09:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:53 devstack sudo[92485]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 1073741824" returned: 0 in 0.994s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:53 devstack sudo[92492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 Jul 06 21:09:53 devstack sudo[92492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:54 devstack sudo[92492]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3" returned: 0 in 0.715s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] <== create_volume: return (1763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.767s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.210s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db7686cd-c831-46d1-8997-f7387ee0684a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f93d55-4baa-4c9e-ba06-e0e3ecfc4be7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Creating offline snapshot 8d07938a-97ac-4ae5-974a-247b93f360f7 of volume 26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:09:54 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Volume volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 (993f9433-b3ec-44a4-87ac-bced47aa4cb3): created successfully Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (48f93d55-4baa-4c9e-ba06-e0e3ecfc4be7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Flow 'volume_create_manager' (f3020361-8dd0-4e50-96ba-2da4c0afd1bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb4ca2ca-f05c-4275-8365-b4c7a662fa7d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:54 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e045a73f-37ee-4166-af84-08e8ecee4e32 tempest-VolumesTransfersTest-1946037555 None] Created volume successfully. Jul 06 21:09:54 devstack sudo[92495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 Jul 06 21:09:54 devstack sudo[92495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:55 devstack sudo[92495]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52" returned: 0 in 0.932s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:55 devstack sudo[92506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 1G Jul 06 21:09:55 devstack sudo[92506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Acquiring lock "cinder-993f9433-b3ec-44a4-87ac-bced47aa4cb3-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-993f9433-b3ec-44a4-87ac-bced47aa4cb3-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Acquiring lock "cinder-quobyte-993f9433-b3ec-44a4-87ac-bced47aa4cb3" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-quobyte-993f9433-b3ec-44a4-87ac-bced47aa4cb3" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee28d12-bc97-4f16-8b33-e87a24e0dd20]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:56 devstack sudo[92514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 Jul 06 21:09:56 devstack sudo[92514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:56 devstack sudo[92506]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 1G" returned: 0 in 1.273s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:56 devstack sudo[92519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 Jul 06 21:09:56 devstack sudo[92519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:57 devstack sudo[92514]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3" returned: 0 in 0.951s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:57 devstack sudo[92524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3 Jul 06 21:09:57 devstack sudo[92524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:57 devstack sudo[92519]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7" returned: 0 in 0.793s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:57 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 is being set with open permissions: ugo+rw Jul 06 21:09:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:57 devstack sudo[92530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 Jul 06 21:09:57 devstack sudo[92530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack sudo[92524]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-993f9433-b3ec-44a4-87ac-bced47aa4cb3" returned: 0 in 0.880s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-quobyte-993f9433-b3ec-44a4-87ac-bced47aa4cb3" released by "delete_volume" :: held 1.906s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Created reservations ['a1c43645-cdc5-423c-97ca-be69430c1903', '8676cbff-e5e4-4ec5-beed-97817ba49bbf', '58c9cf68-dd84-4244-936c-ea9b7c562d56', '10514139-a1cb-4f97-a68e-e127ebe7470e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:58 devstack sudo[92542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:09:58 devstack sudo[92542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:58 devstack sudo[92530]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7" returned: 0 in 0.790s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:58 devstack sudo[92544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.info Jul 06 21:09:58 devstack sudo[92544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:09:59 devstack sudo[92542]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.989s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:59 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:09:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Deleted volume successfully. Jul 06 21:09:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dcda0252-fd33-4a87-87d6-eb15b7d79cf3 tempest-VolumesTransfersTest-2080114836 None] Lock "cinder-993f9433-b3ec-44a4-87ac-bced47aa4cb3-delete_volume" released by "delete_volume" :: held 3.160s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:09:59 devstack sudo[92544]: pam_unix(sudo:session): session closed for user root Jul 06 21:09:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.info" returned: 0 in 1.036s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:09:59 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.info is being set with open permissions: ugo+rw Jul 06 21:09:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:09:59 devstack sudo[92567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.info Jul 06 21:09:59 devstack sudo[92567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:00 devstack sudo[92567]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.info" returned: 0 in 0.876s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.848s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6d353f63-6730-4a63-80f0-e6780cdf3973 tempest-VolumesSnapshotListTestJSON-1192179619 None] Create snapshot completed successfully Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Creating offline snapshot 67671571-069e-4b07-857b-de26272a5c64 of volume 26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f981441-3683-42d9-b73f-10a31016d3b4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:01 devstack sudo[92573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:10:01 devstack sudo[92573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:01 devstack sudo[92575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 Jul 06 21:10:01 devstack sudo[92575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:02 devstack sudo[92573]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.017s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:10:02 devstack sudo[92575]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7" returned: 0 in 1.052s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cbcdae-49d1-4293-b872-eed563083c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:02 devstack sudo[92582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 1G Jul 06 21:10:02 devstack sudo[92582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:03 devstack sudo[92582]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 1G" returned: 0 in 1.071s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:03 devstack sudo[92588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 Jul 06 21:10:03 devstack sudo[92588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:04 devstack sudo[92588]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64" returned: 0 in 0.890s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:04 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 is being set with open permissions: ugo+rw Jul 06 21:10:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:04 devstack sudo[92594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 Jul 06 21:10:04 devstack sudo[92594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:04 devstack sudo[92594]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.974s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b77b5bc8-24ad-464d-9fab-1f2fa528986a tempest-VolumesSnapshotListTestJSON-1192179619 None] Create snapshot completed successfully Jul 06 21:10:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Creating offline snapshot e8777bf2-8478-4f76-b8b0-88ae16124b56 of volume 26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:10:05 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b532b33-65c5-4c42-a990-b1ff36f96f42]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:05 devstack sudo[92597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 Jul 06 21:10:05 devstack sudo[92597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:06 devstack sudo[92597]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64" returned: 0 in 0.880s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cbcdae-49d1-4293-b872-eed563083c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:06 devstack sudo[92602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 1G Jul 06 21:10:06 devstack sudo[92602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:07 devstack sudo[92602]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 1G" returned: 0 in 0.956s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:07 devstack sudo[92609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 Jul 06 21:10:07 devstack sudo[92609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:08 devstack sudo[92609]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56" returned: 0 in 0.899s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:08 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 is being set with open permissions: ugo+rw Jul 06 21:10:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:08 devstack sudo[92615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 Jul 06 21:10:08 devstack sudo[92615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:09 devstack sudo[92615]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56" returned: 0 in 0.705s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.580s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2b76b2e7-ea77-4d14-8f02-cb1d1f7364f4 tempest-VolumesSnapshotListTestJSON-1192179619 None] Create snapshot completed successfully Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-e8777bf2-8478-4f76-b8b0-88ae16124b56-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-e8777bf2-8478-4f76-b8b0-88ae16124b56-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-quobyte-e8777bf2-8478-4f76-b8b0-88ae16124b56" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-e8777bf2-8478-4f76-b8b0-88ae16124b56" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Deleting offline snapshot e8777bf2-8478-4f76-b8b0-88ae16124b56 of volume 26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] snapshot_file for this snap is: volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[136dbf9d-1b69-40c3-aef7-0637208c14e2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:11 devstack sudo[92618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 Jul 06 21:10:11 devstack sudo[92618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:12 devstack sudo[92618]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56" returned: 0 in 1.376s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cbcdae-49d1-4293-b872-eed563083c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0234a78a-4c12-45f5-9b76-9a9f14b37bd5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:12 devstack sudo[92624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 Jul 06 21:10:12 devstack sudo[92624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Flow 'volume_create_manager' (b67c67c6-46d7-432b-be52-a20c61ccaeba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7640968e-11f4-43f3-8f9e-6f4ffa41b570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7640968e-11f4-43f3-8f9e-6f4ffa41b570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-198742071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fe4c36-18cf-4f6c-a0f4-a41922b1c83f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f81c62d01db84210a84763e45dd80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:13Z,use_quota=True,user_id='050dd30a9d764c7eb72d7d152f646198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3200dd34-8108-4b8b-8011-13c4965abea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3200dd34-8108-4b8b-8011-13c4965abea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d44ee9-8c7d-44f4-9350-7fe6de34bf19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00d44ee9-8c7d-44f4-9350-7fe6de34bf19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92fe4c36-18cf-4f6c-a0f4-a41922b1c83f', 'volume_name': 'volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4131c452-e68a-455b-ae15-824f529f69bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4131c452-e68a-455b-ae15-824f529f69bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1d0c96-4791-43f0-bf21-18311bac0a77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Volume 92fe4c36-18cf-4f6c-a0f4-a41922b1c83f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f', 'volume_size': 1} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-198742071',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92fe4c36-18cf-4f6c-a0f4-a41922b1c83f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f81c62d01db84210a84763e45dd80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:13Z,use_quota=True,user_id='050dd30a9d764c7eb72d7d152f646198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Creating volume 92fe4c36-18cf-4f6c-a0f4-a41922b1c83f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:12 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:10:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:12 devstack sudo[92626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f 1073741824 Jul 06 21:10:12 devstack sudo[92626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:13 devstack sudo[92624]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64" returned: 0 in 1.093s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cbcdae-49d1-4293-b872-eed563083c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:13 devstack sudo[92631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 Jul 06 21:10:13 devstack sudo[92631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:14 devstack sudo[92626]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f 1073741824" returned: 0 in 1.192s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:14 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f Jul 06 21:10:14 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:14 devstack sudo[92631]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56" returned: 0 in 1.218s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:14 devstack sudo[92643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56 Jul 06 21:10:14 devstack sudo[92643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:15 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f" returned: 0 in 0.914s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] <== create_volume: return (2178ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.182s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c1d0c96-4791-43f0-bf21-18311bac0a77) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b0a27f-e78b-4ce4-8d39-3afff9ae48fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:15 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Volume volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f (92fe4c36-18cf-4f6c-a0f4-a41922b1c83f): created successfully Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99b0a27f-e78b-4ce4-8d39-3afff9ae48fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Flow 'volume_create_manager' (b67c67c6-46d7-432b-be52-a20c61ccaeba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:15 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-710a9c75-f6a0-4b56-9637-76bc3162e34e tempest-VolumesListTestJSON-309106955 None] Created volume successfully. Jul 06 21:10:15 devstack sudo[92643]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.e8777bf2-8478-4f76-b8b0-88ae16124b56" returned: 0 in 0.905s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-e8777bf2-8478-4f76-b8b0-88ae16124b56" released by "_delete_snapshot" :: held 4.727s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" released by "delete_snapshot" :: held 4.761s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Created reservations ['ab742d9d-c2ae-4bae-88ee-ae730184fca9', '4b570dae-5ce5-47fb-99af-40d0890a19b9', '8cd386df-d3b3-4a5b-a942-311b71aae574', '7935949a-a040-4507-a79e-dc3364171e36'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:15 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Delete snapshot completed successfully. Jul 06 21:10:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-670140b0-1fd2-4a80-a3bd-acaa9e567495 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-e8777bf2-8478-4f76-b8b0-88ae16124b56-delete_snapshot" released by "delete_snapshot" :: held 4.940s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-67671571-069e-4b07-857b-de26272a5c64-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-67671571-069e-4b07-857b-de26272a5c64-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-quobyte-67671571-069e-4b07-857b-de26272a5c64" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-67671571-069e-4b07-857b-de26272a5c64" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Deleting offline snapshot 67671571-069e-4b07-857b-de26272a5c64 of volume 26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] snapshot_file for this snap is: volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d32050da-9317-4420-9550-4dbc23b2f307]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:16 devstack sudo[92647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 Jul 06 21:10:16 devstack sudo[92647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=75,cinder:UPDATE=109,cinder:DELETE=7,cinder:INSERT=28 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=80,cinder:UPDATE=115,cinder:INSERT=23,cinder:DELETE=15 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Flow 'volume_create_manager' (849ab9cb-4cf7-4a95-8158-d7b8a4c85e87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d131e9a-8238-48bd-83be-9c7bf078f26a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d131e9a-8238-48bd-83be-9c7bf078f26a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-49990753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a77b90-3587-4694-b187-988a9c21313f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f81c62d01db84210a84763e45dd80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:17Z,use_quota=True,user_id='050dd30a9d764c7eb72d7d152f646198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0e45d-0e8b-43e4-96b8-3e464a9072a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e0e45d-0e8b-43e4-96b8-3e464a9072a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb11c83-4fc1-4392-9622-b13c5298ff13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (deb11c83-4fc1-4392-9622-b13c5298ff13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61a77b90-3587-4694-b187-988a9c21313f', 'volume_name': 'volume-61a77b90-3587-4694-b187-988a9c21313f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2772f42a-b921-411c-ab3a-4a56be9b41b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2772f42a-b921-411c-ab3a-4a56be9b41b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddb8f50-39c2-48b3-8173-26e69d0b98bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:16 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Volume 61a77b90-3587-4694-b187-988a9c21313f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61a77b90-3587-4694-b187-988a9c21313f', 'volume_size': 1} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-49990753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61a77b90-3587-4694-b187-988a9c21313f,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f81c62d01db84210a84763e45dd80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:17Z,use_quota=True,user_id='050dd30a9d764c7eb72d7d152f646198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Creating volume 61a77b90-3587-4694-b187-988a9c21313f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:16 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:10:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:16 devstack sudo[92649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f 1073741824 Jul 06 21:10:16 devstack sudo[92649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:17 devstack sudo[92647]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64" returned: 0 in 0.975s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cbcdae-49d1-4293-b872-eed563083c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:17 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d97fe031-a0fa-498b-97b6-c244ef3561df]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:17 devstack sudo[92654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 Jul 06 21:10:17 devstack sudo[92654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:18 devstack sudo[92649]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f 1073741824" returned: 0 in 1.159s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:18 devstack sudo[92661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f Jul 06 21:10:18 devstack sudo[92661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:18 devstack sudo[92654]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7" returned: 0 in 0.941s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cbcdae-49d1-4293-b872-eed563083c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:18 devstack sudo[92666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 Jul 06 21:10:18 devstack sudo[92666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:18 devstack sudo[92661]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f" returned: 0 in 0.834s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.068s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ddb8f50-39c2-48b3-8173-26e69d0b98bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61a77b90-3587-4694-b187-988a9c21313f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:19 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1331e720-ab7c-4534-b8b4-63222c47f9da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:19 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Volume volume-61a77b90-3587-4694-b187-988a9c21313f (61a77b90-3587-4694-b187-988a9c21313f): created successfully Jul 06 21:10:19 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1331e720-ab7c-4534-b8b4-63222c47f9da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:19 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Flow 'volume_create_manager' (849ab9cb-4cf7-4a95-8158-d7b8a4c85e87) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d4c324e5-b696-4d77-be38-6971a1f445f8 tempest-VolumesListTestJSON-309106955 None] Created volume successfully. Jul 06 21:10:19 devstack sudo[92666]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64" returned: 0 in 0.992s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:19 devstack sudo[92672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64 Jul 06 21:10:19 devstack sudo[92672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:20 devstack sudo[92672]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.67671571-069e-4b07-857b-de26272a5c64" returned: 0 in 0.844s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-67671571-069e-4b07-857b-de26272a5c64" released by "_delete_snapshot" :: held 3.906s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" released by "delete_snapshot" :: held 3.940s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Created reservations ['ed5796e2-c0b8-4d93-8e39-d7a11fea9dd0', '3f120302-30e5-470b-94bb-e038c199a244', '033f3301-f5af-406d-93a3-1c0a3328214d', 'adc2c551-c426-46af-b1b2-8edcd11ec90b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Delete snapshot completed successfully. Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-42ea5d29-79ea-472f-9333-5f4528fbcac1 tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-67671571-069e-4b07-857b-de26272a5c64-delete_snapshot" released by "delete_snapshot" :: held 4.260s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-8d07938a-97ac-4ae5-974a-247b93f360f7-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-8d07938a-97ac-4ae5-974a-247b93f360f7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" acquired by "delete_snapshot" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-quobyte-8d07938a-97ac-4ae5-974a-247b93f360f7" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-8d07938a-97ac-4ae5-974a-247b93f360f7" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Deleting offline snapshot 8d07938a-97ac-4ae5-974a-247b93f360f7 of volume 26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] snapshot_file for this snap is: volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f760c309-824a-4688-9f54-27ab6d4b18b2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Flow 'volume_create_manager' (fe3d3c03-37cc-4827-9b1a-0e9699c82ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:20 devstack sudo[92679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 Jul 06 21:10:20 devstack sudo[92679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b48e1a3-c4e4-44e5-a5f9-b2ab01d53e7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b48e1a3-c4e4-44e5-a5f9-b2ab01d53e7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-814229479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc09610-3c1e-4ef1-b50b-7ea98b4c7909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f81c62d01db84210a84763e45dd80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:21Z,use_quota=True,user_id='050dd30a9d764c7eb72d7d152f646198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b36fc8d-b625-4686-9609-14302b96e359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b36fc8d-b625-4686-9609-14302b96e359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc48d38-d033-4afc-8a25-4b146242b339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddc48d38-d033-4afc-8a25-4b146242b339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fc09610-3c1e-4ef1-b50b-7ea98b4c7909', 'volume_name': 'volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb74a3a-f65f-4a88-9a56-cbf389e63665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2bb74a3a-f65f-4a88-9a56-cbf389e63665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f1bb4e-b6bd-4349-9127-b76b5623a12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Volume 5fc09610-3c1e-4ef1-b50b-7ea98b4c7909: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909', 'volume_size': 1} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-814229479',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fc09610-3c1e-4ef1-b50b-7ea98b4c7909,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f81c62d01db84210a84763e45dd80def',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:21Z,use_quota=True,user_id='050dd30a9d764c7eb72d7d152f646198',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Creating volume 5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:20 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:10:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:20 devstack sudo[92681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 1073741824 Jul 06 21:10:20 devstack sudo[92681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:21 devstack sudo[92679]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7" returned: 0 in 0.945s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-26cbcdae-49d1-4293-b872-eed563083c52(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:10:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5805c6d0-dd39-46a9-89c0-c5c340f5b434]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:21 devstack sudo[92691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 Jul 06 21:10:21 devstack sudo[92691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:22 devstack sudo[92681]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 1073741824" returned: 0 in 1.130s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:22 devstack sudo[92694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 Jul 06 21:10:22 devstack sudo[92694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:22 devstack sudo[92691]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52" returned: 0 in 0.890s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:22 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 Jul 06 21:10:22 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:22 devstack sudo[92694]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909" returned: 0 in 0.784s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.959s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f1bb4e-b6bd-4349-9127-b76b5623a12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa5940f-ed30-43bf-9888-112b0f89a3a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:22 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Volume volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 (5fc09610-3c1e-4ef1-b50b-7ea98b4c7909): created successfully Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8aa5940f-ed30-43bf-9888-112b0f89a3a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Flow 'volume_create_manager' (fe3d3c03-37cc-4827-9b1a-0e9699c82ada) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:22 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a1ed934b-0684-4ee7-9aa5-8f174a1469ae tempest-VolumesListTestJSON-309106955 None] Created volume successfully. Jul 06 21:10:23 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7" returned: 0 in 0.884s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:23 devstack sudo[92706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7 Jul 06 21:10:23 devstack sudo[92706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:24 devstack sudo[92706]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52.8d07938a-97ac-4ae5-974a-247b93f360f7" returned: 0 in 0.701s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-8d07938a-97ac-4ae5-974a-247b93f360f7" released by "_delete_snapshot" :: held 3.569s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" released by "delete_snapshot" :: held 3.602s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:24 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Created reservations ['1260d19c-2144-421a-ada0-73d0b194ea76', 'a5917946-5924-4488-b2ee-ddc64f405495', '02ba9430-d1d9-475d-ab9e-af94e0cefc3a', 'e4dd8525-7b06-4968-bd64-f6ea84c8de90'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Delete snapshot completed successfully. Jul 06 21:10:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3ced79ab-8255-4523-941e-ef1df5f7a8cc tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-8d07938a-97ac-4ae5-974a-247b93f360f7-delete_snapshot" released by "delete_snapshot" :: held 3.778s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-26cbcdae-49d1-4293-b872-eed563083c52-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-26cbcdae-49d1-4293-b872-eed563083c52-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:25 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf9e67a-f50d-41d9-8a51-637fa5db73bd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:25 devstack sudo[92709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 Jul 06 21:10:25 devstack sudo[92709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:26 devstack sudo[92709]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52" returned: 0 in 1.233s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:26 devstack sudo[92714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52 Jul 06 21:10:26 devstack sudo[92714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "cinder-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "cinder-quobyte-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-quobyte-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[06fcb107-cdea-458c-af0b-abe31f8bcd69]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:27 devstack sudo[92716]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 Jul 06 21:10:27 devstack sudo[92716]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:27 devstack sudo[92714]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-26cbcdae-49d1-4293-b872-eed563083c52" returned: 0 in 0.933s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-quobyte-26cbcdae-49d1-4293-b872-eed563083c52" released by "delete_volume" :: held 2.281s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Created reservations ['3f2c897d-e850-404c-bff8-fc183d1ddfe8', 'a5a2fb3c-3505-4ec1-8f42-bb8f36c38c7a', '0a69047e-8ea3-40a3-b8eb-ab96f6cdce54', '4ad56318-8a36-4b9f-aa0b-6b374f95ac11'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:27 devstack sudo[92728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:10:27 devstack sudo[92728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:28 devstack sudo[92716]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909" returned: 0 in 1.126s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:28 devstack sudo[92740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909 Jul 06 21:10:28 devstack sudo[92740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:28 devstack sudo[92728]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.897s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Deleted volume successfully. Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6af0fdc2-dcfe-4257-875a-f845bf23541a tempest-VolumesSnapshotListTestJSON-1192179619 None] Lock "cinder-26cbcdae-49d1-4293-b872-eed563083c52-delete_volume" released by "delete_volume" :: held 3.628s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:28 devstack sudo[92740]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909" returned: 0 in 0.750s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-quobyte-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909" released by "delete_volume" :: held 1.943s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Created reservations ['54e0c964-9e2b-4994-bc02-f436fc63aec0', '7d6bfbf4-4b7c-42cb-9caa-326c70b09602', 'd6a6aaff-dae7-4f2a-b1a7-3a4112c6ded3', '1b11a478-110b-4223-95fd-d6e6d45cf724'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:29 devstack sudo[92747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:10:29 devstack sudo[92747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "cinder-61a77b90-3587-4694-b187-988a9c21313f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-61a77b90-3587-4694-b187-988a9c21313f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "cinder-quobyte-61a77b90-3587-4694-b187-988a9c21313f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-quobyte-61a77b90-3587-4694-b187-988a9c21313f" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d657624e-c517-4100-a559-7bfe56365ef9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:29 devstack sudo[92749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f Jul 06 21:10:29 devstack sudo[92749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:29 devstack sudo[92747]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.910s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:29 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Deleted volume successfully. Jul 06 21:10:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-77dc54e0-7572-4647-9b6c-2ab36de772d8 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-5fc09610-3c1e-4ef1-b50b-7ea98b4c7909-delete_volume" released by "delete_volume" :: held 3.193s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:30 devstack sudo[92749]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f" returned: 0 in 1.016s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:30 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f Jul 06 21:10:30 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:31 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-61a77b90-3587-4694-b187-988a9c21313f" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-quobyte-61a77b90-3587-4694-b187-988a9c21313f" released by "delete_volume" :: held 1.853s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Created reservations ['8b012cf3-f88e-40cc-827c-55c88efa5618', 'a379ff68-23e2-48bb-9e2d-1b15517e7ac9', '653237d9-1d7f-4a94-beed-ff0b702744d5', 'c95671f7-a02e-4f07-8e01-8dc75087d6d1'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:31 devstack sudo[92758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:10:31 devstack sudo[92758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Acquiring lock "cinder-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Lock "cinder-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Acquiring lock "cinder-quobyte-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Lock "cinder-quobyte-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fbaa5d0-1cf2-4402-b79b-7bd52aa7eb3b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:32 devstack sudo[92769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f Jul 06 21:10:32 devstack sudo[92769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:32 devstack sudo[92758]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.226s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:32 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Deleted volume successfully. Jul 06 21:10:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6f5c4cd6-ef76-45e7-8066-91579570aa84 tempest-VolumesListTestJSON-309106955 None] Lock "cinder-61a77b90-3587-4694-b187-988a9c21313f-delete_volume" released by "delete_volume" :: held 3.438s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:33 devstack sudo[92769]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f" returned: 0 in 1.287s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:33 devstack sudo[92814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f Jul 06 21:10:33 devstack sudo[92814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:34 devstack sudo[92814]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f" returned: 0 in 0.938s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Lock "cinder-quobyte-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f" released by "delete_volume" :: held 2.344s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Created reservations ['9499d719-5ba7-4444-8d28-8278b2ba7b15', 'aec8c6ad-6e7e-4234-a4ef-bdfcc50c4f09', 'eebca1ce-847b-49f1-b0f9-e71cd8395e07', 'dd6486f8-77bf-4cbb-b94a-729722789462'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:34 devstack sudo[92840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:10:34 devstack sudo[92840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:35 devstack sudo[92840]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.057s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:35 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:10:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Deleted volume successfully. Jul 06 21:10:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b291fa13-642a-42f0-9711-e38f661067cf tempest-VolumesListTestJSON-309106955 None] Lock "cinder-92fe4c36-18cf-4f6c-a0f4-a41922b1c83f-delete_volume" released by "delete_volume" :: held 3.816s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:10:44 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=37,cinder:UPDATE=43,cinder:DELETE=3,cinder:INSERT=14 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:10:45 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=30,cinder:INSERT=12,cinder:UPDATE=54,cinder:DELETE=3 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (21e94d86-e806-49be-ad5a-32cd6caa0796) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7052cd4-8c34-42a5-ac4d-7d2294e63067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7052cd4-8c34-42a5-ac4d-7d2294e63067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-76746751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a11bcb-9848-4855-b38f-a486f134033c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:53Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f808c1-ccb2-4e51-a20b-fba1dbf3a484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78f808c1-ccb2-4e51-a20b-fba1dbf3a484) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da054626-acc2-44a3-9da0-c2e5f347b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da054626-acc2-44a3-9da0-c2e5f347b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36a11bcb-9848-4855-b38f-a486f134033c', 'volume_name': 'volume-36a11bcb-9848-4855-b38f-a486f134033c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9c425b-8194-40dd-a784-4ae344f025ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df9c425b-8194-40dd-a784-4ae344f025ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63ccd88-38be-474e-8e18-d2f73978916e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:53 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Volume 36a11bcb-9848-4855-b38f-a486f134033c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36a11bcb-9848-4855-b38f-a486f134033c', 'volume_size': 1} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:10:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-76746751',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36a11bcb-9848-4855-b38f-a486f134033c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:10:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:10:53Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Creating volume 36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:10:53 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:10:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:53 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c 1073741824 Jul 06 21:10:53 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:54 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c 1073741824" returned: 0 in 0.912s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:54 devstack sudo[92936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c Jul 06 21:10:54 devstack sudo[92936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:55 devstack sudo[92936]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] <== create_volume: return (1649ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.654s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c63ccd88-38be-474e-8e18-d2f73978916e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36a11bcb-9848-4855-b38f-a486f134033c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635720fd-b52e-4506-bf3e-a0229b6b778f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:10:55 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Volume volume-36a11bcb-9848-4855-b38f-a486f134033c (36a11bcb-9848-4855-b38f-a486f134033c): created successfully Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (635720fd-b52e-4506-bf3e-a0229b6b778f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (21e94d86-e806-49be-ad5a-32cd6caa0796) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:10:55 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6d5f9a1c-554e-4610-a034-e779f59fbe28 tempest-VolumesSnapshotTestJSON-179613753 None] Created volume successfully. Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:10:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Creating offline snapshot 9440cc8d-8b08-4944-b634-d5d10955c114 of volume 36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:10:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb240a27-c8bd-4f3a-8408-d48c7ab70b30]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:10:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:56 devstack sudo[92982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c Jul 06 21:10:56 devstack sudo[92982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:57 devstack sudo[92982]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c" returned: 0 in 1.011s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:57 devstack sudo[92999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 1G Jul 06 21:10:57 devstack sudo[92999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:58 devstack sudo[92999]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 1G" returned: 0 in 1.374s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a11bcb-9848-4855-b38f-a486f134033c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:58 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a11bcb-9848-4855-b38f-a486f134033c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 Jul 06 21:10:58 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:10:59 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Jul 06 21:10:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-36a11bcb-9848-4855-b38f-a486f134033c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114" returned: 0 in 1.203s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:10:59 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 is being set with open permissions: ugo+rw Jul 06 21:10:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:10:59 devstack sudo[93038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 Jul 06 21:10:59 devstack sudo[93038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:00 devstack sudo[93038]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114" returned: 0 in 1.283s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:01 devstack sudo[93045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.info Jul 06 21:11:01 devstack sudo[93045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:01 devstack sudo[93047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:11:01 devstack sudo[93047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Flow 'volume_create_manager' (f01baba6-8bf8-4392-adb7-3d53e89ba9c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b771416-a560-44c5-8099-4eb8a70ba0d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b771416-a560-44c5-8099-4eb8a70ba0d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-625165840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b662c6bc-48d0-44f9-9ced-62ff92b6e336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27100f871ea48bf9be7b8e276f68309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:01Z,use_quota=True,user_id='2736151ce4c24fa487024b2b3a7b0e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c042eed3-c3ba-43ef-8ba5-9de6f5dca797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c042eed3-c3ba-43ef-8ba5-9de6f5dca797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5680550b-d01f-4285-b177-b3b47248cddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5680550b-d01f-4285-b177-b3b47248cddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b662c6bc-48d0-44f9-9ced-62ff92b6e336', 'volume_name': 'volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d35e52-6aa6-492c-b38a-12422be9a1f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c6d35e52-6aa6-492c-b38a-12422be9a1f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a4a2ae-f3f0-47a0-9d23-0e4f54501b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:01 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Volume b662c6bc-48d0-44f9-9ced-62ff92b6e336: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336', 'volume_size': 1} Jul 06 21:11:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:02 devstack sudo[93047]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.107s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:11:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:11:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:11:02 devstack sudo[93045]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.info" returned: 0 in 1.396s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:02 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.info is being set with open permissions: ugo+rw Jul 06 21:11:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:02 devstack sudo[93052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.info Jul 06 21:11:02 devstack sudo[93052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:03 devstack sudo[93052]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.info" returned: 0 in 0.995s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 7.451s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.928s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-625165840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b662c6bc-48d0-44f9-9ced-62ff92b6e336,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27100f871ea48bf9be7b8e276f68309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:01Z,use_quota=True,user_id='2736151ce4c24fa487024b2b3a7b0e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Creating volume b662c6bc-48d0-44f9-9ced-62ff92b6e336 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:03 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:11:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:03 devstack sudo[93055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 1073741824 Jul 06 21:11:03 devstack sudo[93055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7c75413c-add0-4f95-bbde-10e809427745 tempest-VolumesSnapshotTestJSON-179613753 None] Create snapshot completed successfully Jul 06 21:11:04 devstack sudo[93055]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 1073741824" returned: 0 in 1.303s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:04 devstack sudo[93061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 Jul 06 21:11:04 devstack sudo[93061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-9440cc8d-8b08-4944-b634-d5d10955c114-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-9440cc8d-8b08-4944-b634-d5d10955c114-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-36a11bcb-9848-4855-b38f-a486f134033c" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-36a11bcb-9848-4855-b38f-a486f134033c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-9440cc8d-8b08-4944-b634-d5d10955c114" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-9440cc8d-8b08-4944-b634-d5d10955c114" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Deleting offline snapshot 9440cc8d-8b08-4944-b634-d5d10955c114 of volume 36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] snapshot_file for this snap is: volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bf495f0-319b-4eef-9c72-32697aff6c8c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:05 devstack sudo[93063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 Jul 06 21:11:05 devstack sudo[93063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:06 devstack sudo[93061]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336" returned: 0 in 1.352s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] <== create_volume: return (2782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.787s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10a4a2ae-f3f0-47a0-9d23-0e4f54501b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df30ad36-f6ab-4282-8760-7ceb57b6d6e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:06 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Volume volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 (b662c6bc-48d0-44f9-9ced-62ff92b6e336): created successfully Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df30ad36-f6ab-4282-8760-7ceb57b6d6e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Flow 'volume_create_manager' (f01baba6-8bf8-4392-adb7-3d53e89ba9c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-addd01b7-4fce-4383-9dd5-cbf2bbd59989 tempest-AttachVolumeTestJSON-697008879 None] Created volume successfully. Jul 06 21:11:06 devstack sudo[93063]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114" returned: 0 in 1.098s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-36a11bcb-9848-4855-b38f-a486f134033c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a88960c4-dc0a-4271-92d1-7985e81fa018]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:06 devstack sudo[93070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c Jul 06 21:11:06 devstack sudo[93070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:07 devstack sudo[93070]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c" returned: 0 in 1.015s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:07 devstack sudo[93080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 Jul 06 21:11:07 devstack sudo[93080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:08 devstack sudo[93080]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114" returned: 0 in 0.946s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:08 devstack sudo[93087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114 Jul 06 21:11:08 devstack sudo[93087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:09 devstack sudo[93087]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c.9440cc8d-8b08-4944-b634-d5d10955c114" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-9440cc8d-8b08-4944-b634-d5d10955c114" released by "_delete_snapshot" :: held 4.060s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-36a11bcb-9848-4855-b38f-a486f134033c" released by "delete_snapshot" :: held 4.104s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:09 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['5958157a-7859-4ac8-9fda-15732bfcf969', '539a1c49-4672-4e14-8c98-527913da9a28', '7b0d0c35-9752-453d-a334-424d8a862855', 'a6c74104-573a-41bb-807e-462750b0ef57'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Delete snapshot completed successfully. Jul 06 21:11:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-24411131-dfc0-4413-bff8-a83b80ba9002 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-9440cc8d-8b08-4944-b634-d5d10955c114-delete_snapshot" released by "delete_snapshot" :: held 4.433s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-7308dd79-0e22-4ef8-aeec-96b63f4c0582 req-95283fc8-47ad-4062-914b-2691beccf2a6 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-7308dd79-0e22-4ef8-aeec-96b63f4c0582 req-95283fc8-47ad-4062-914b-2691beccf2a6 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[178b3133-5d8d-458e-97b7-f5a678711156]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-7308dd79-0e22-4ef8-aeec-96b63f4c0582 req-95283fc8-47ad-4062-914b-2691beccf2a6 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:10 devstack sudo[93103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 Jul 06 21:11:10 devstack sudo[93103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (5ab972cd-8294-4463-b7c0-6a05f7dd45e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a36ca-a86e-47a2-9150-8de63e1f5f08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4a6a36ca-a86e-47a2-9150-8de63e1f5f08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-907864146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188378be-6a27-481a-9e30-6a3fa30ff9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:11Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74f2438-f93c-45c8-af39-4833b14daeaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c74f2438-f93c-45c8-af39-4833b14daeaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc62e5d-1ad7-4ef5-a536-b77619a58132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cc62e5d-1ad7-4ef5-a536-b77619a58132) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '188378be-6a27-481a-9e30-6a3fa30ff9ff', 'volume_name': 'volume-188378be-6a27-481a-9e30-6a3fa30ff9ff', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6895189c-465b-4df0-9386-59fb8c350337) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6895189c-465b-4df0-9386-59fb8c350337) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde8cd9a-91d5-4a00-998f-6f5738cac213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:11 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Volume 188378be-6a27-481a-9e30-6a3fa30ff9ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-188378be-6a27-481a-9e30-6a3fa30ff9ff', 'volume_size': 1} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:11 devstack sudo[93103]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-7308dd79-0e22-4ef8-aeec-96b63f4c0582 req-95283fc8-47ad-4062-914b-2691beccf2a6 tempest-AttachVolumeTestJSON-697008879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336" returned: 0 in 1.213s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-7308dd79-0e22-4ef8-aeec-96b63f4c0582 req-95283fc8-47ad-4062-914b-2691beccf2a6 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.242s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.321s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-907864146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=188378be-6a27-481a-9e30-6a3fa30ff9ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:11Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Creating volume 188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:11 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:11 devstack sudo[93135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff 1073741824 Jul 06 21:11:11 devstack sudo[93135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-7308dd79-0e22-4ef8-aeec-96b63f4c0582 req-95283fc8-47ad-4062-914b-2691beccf2a6 tempest-AttachVolumeTestJSON-697008879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '25404ee1-aed5-4f21-9ae9-891519ac851b', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:11:11 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-7308dd79-0e22-4ef8-aeec-96b63f4c0582 req-95283fc8-47ad-4062-914b-2691beccf2a6 tempest-AttachVolumeTestJSON-697008879 None] attachment_update completed successfully. Jul 06 21:11:12 devstack sudo[93135]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff 1073741824" returned: 0 in 0.864s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:12 devstack sudo[93208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff Jul 06 21:11:12 devstack sudo[93208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:13 devstack sudo[93208]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff" returned: 0 in 0.662s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bde8cd9a-91d5-4a00-998f-6f5738cac213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-188378be-6a27-481a-9e30-6a3fa30ff9ff', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5890d85-998c-4fe6-a810-1d87c6e266ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Volume volume-188378be-6a27-481a-9e30-6a3fa30ff9ff (188378be-6a27-481a-9e30-6a3fa30ff9ff): created successfully Jul 06 21:11:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5890d85-998c-4fe6-a810-1d87c6e266ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (5ab972cd-8294-4463-b7c0-6a05f7dd45e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0778e4a3-8f3b-435b-92b2-9cb0c88a727b tempest-VolumesSnapshotTestJSON-179613753 None] Created volume successfully. Jul 06 21:11:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Creating offline snapshot 437c83cd-2180-4c0c-817a-d1fb27498d9d of volume 188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:11:14 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[684e93f2-9c1c-4e7a-9ea5-1d9f0c07bd5e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:14 devstack sudo[93527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff Jul 06 21:11:14 devstack sudo[93527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:15 devstack sudo[93527]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff" returned: 0 in 0.834s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:15 devstack sudo[93532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d 1G Jul 06 21:11:15 devstack sudo[93532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:16 devstack sudo[93532]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d 1G" returned: 0 in 0.920s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188378be-6a27-481a-9e30-6a3fa30ff9ff -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:16 devstack sudo[93538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188378be-6a27-481a-9e30-6a3fa30ff9ff -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d Jul 06 21:11:16 devstack sudo[93538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:17 devstack sudo[93538]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-188378be-6a27-481a-9e30-6a3fa30ff9ff -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d" returned: 0 in 0.840s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:17 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d is being set with open permissions: ugo+rw Jul 06 21:11:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:17 devstack sudo[93560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d Jul 06 21:11:17 devstack sudo[93560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:17 devstack sudo[93560]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d" returned: 0 in 0.615s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:17 devstack sudo[93565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.info Jul 06 21:11:17 devstack sudo[93565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:18 devstack sudo[93565]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.info" returned: 0 in 0.666s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:18 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.info is being set with open permissions: ugo+rw Jul 06 21:11:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:18 devstack sudo[93575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.info Jul 06 21:11:18 devstack sudo[93575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:19 devstack sudo[93575]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.info" returned: 0 in 0.764s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.750s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-596cce6d-24ec-492d-94fb-b114c0c1dac0 tempest-VolumesSnapshotTestJSON-179613753 None] Create snapshot completed successfully Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (d03b5a94-89e2-422b-a3cf-b525f487035d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ab18a-8f20-4282-983a-fdfe90735769) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e23ab18a-8f20-4282-983a-fdfe90735769) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1214821645',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=365766b1-9f58-42c1-94fc-0e2651f3eea0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:20Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=437c83cd-2180-4c0c-817a-d1fb27498d9d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:20Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cc91ce-3863-4364-a7f3-d15573725c14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5cc91ce-3863-4364-a7f3-d15573725c14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268dbe59-15ab-4684-b0bc-000256da40f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (268dbe59-15ab-4684-b0bc-000256da40f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '365766b1-9f58-42c1-94fc-0e2651f3eea0', 'volume_name': 'volume-365766b1-9f58-42c1-94fc-0e2651f3eea0', 'volume_size': 2, 'snapshot_id': '437c83cd-2180-4c0c-817a-d1fb27498d9d'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec15cb3-9dd3-4f86-8f4c-3ccff919427a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0ec15cb3-9dd3-4f86-8f4c-3ccff919427a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95455a2a-d6c4-4378-98b8-c5ab67ae3db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Volume 365766b1-9f58-42c1-94fc-0e2651f3eea0: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-365766b1-9f58-42c1-94fc-0e2651f3eea0', 'volume_size': 2, 'snapshot_id': '437c83cd-2180-4c0c-817a-d1fb27498d9d'} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-437c83cd-2180-4c0c-817a-d1fb27498d9d-365766b1-9f58-42c1-94fc-0e2651f3eea0" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-437c83cd-2180-4c0c-817a-d1fb27498d9d-365766b1-9f58-42c1-94fc-0e2651f3eea0" acquired by "_create_volume_from_snapshot" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Creating volume 365766b1-9f58-42c1-94fc-0e2651f3eea0 from snapshot 437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-365766b1-9f58-42c1-94fc-0e2651f3eea0" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-365766b1-9f58-42c1-94fc-0e2651f3eea0" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] snapshot: 437c83cd-2180-4c0c-817a-d1fb27498d9d, volume: 365766b1-9f58-42c1-94fc-0e2651f3eea0, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f412f5c-fa44-432d-8818-e1a246d0ca29]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:21 devstack sudo[93607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d Jul 06 21:11:21 devstack sudo[93607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:21 devstack sudo[93607]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d" returned: 0 in 1.097s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188378be-6a27-481a-9e30-6a3fa30ff9ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:11:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:11:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d30b16ce-6bd6-4254-9b4c-3e10f4e37b46]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:22 devstack sudo[93632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff Jul 06 21:11:22 devstack sudo[93632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:22 devstack sudo[93632]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff" returned: 0 in 0.923s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:22 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:11:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:22 devstack sudo[93657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 Jul 06 21:11:22 devstack sudo[93657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:28 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Flow 'volume_create_manager' (8696312d-cc88-4d07-aa16-3a6b3fc53b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d543dbee-8d01-4a6b-ba44-7eee57320edf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d543dbee-8d01-4a6b-ba44-7eee57320edf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-383395659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e03606f-bb3c-4ebe-8b7f-ad9698bd0684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac8fb1b2ceb4eca998ebc1f061369d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:29Z,use_quota=True,user_id='7b7604501cb8487a9c9e5f64b0397a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f29b8d1-2f0f-4570-8b63-3bbf96dd9f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f29b8d1-2f0f-4570-8b63-3bbf96dd9f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a694abad-e0f0-47b8-b92c-1349bfd6e98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a694abad-e0f0-47b8-b92c-1349bfd6e98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e03606f-bb3c-4ebe-8b7f-ad9698bd0684', 'volume_name': 'volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af50946c-a317-4710-b240-7c0114dde6cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af50946c-a317-4710-b240-7c0114dde6cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22849187-5bb5-4021-9709-20a64159e5d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:29 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Volume 6e03606f-bb3c-4ebe-8b7f-ad9698bd0684: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684', 'volume_size': 1} Jul 06 21:11:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:31 devstack sudo[93657]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0" returned: 0 in 8.256s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:31 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a39177-1b0e-4616-837d-4e7f59d75895]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:31 devstack sudo[93798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff Jul 06 21:11:31 devstack sudo[93798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:32 devstack sudo[93798]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff" returned: 0 in 1.810s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:32 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff, size 1024.00 MB, duration 8.26 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:11:32 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Converted 1024.00 MB image at 124.00 MB/s Jul 06 21:11:32 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 is being set with open permissions: ugo+rw Jul 06 21:11:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:33 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 Jul 06 21:11:33 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:33 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0" returned: 0 in 0.945s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-365766b1-9f58-42c1-94fc-0e2651f3eea0" released by "_copy_volume_from_snapshot" :: held 13.251s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-437c83cd-2180-4c0c-817a-d1fb27498d9d-365766b1-9f58-42c1-94fc-0e2651f3eea0" released by "_create_volume_from_snapshot" :: held 13.317s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.353s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.889s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-383395659',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e03606f-bb3c-4ebe-8b7f-ad9698bd0684,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1ac8fb1b2ceb4eca998ebc1f061369d5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:29Z,use_quota=True,user_id='7b7604501cb8487a9c9e5f64b0397a94',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Creating volume 6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:34 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:34 devstack sudo[94190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 1073741824 Jul 06 21:11:34 devstack sudo[94190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95455a2a-d6c4-4378-98b8-c5ab67ae3db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-365766b1-9f58-42c1-94fc-0e2651f3eea0', 'volume_size': 2, 'snapshot_id': '437c83cd-2180-4c0c-817a-d1fb27498d9d'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea5fca9-7538-4369-92a0-b8664f18ff31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:34 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Volume volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 (365766b1-9f58-42c1-94fc-0e2651f3eea0): created successfully Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fea5fca9-7538-4369-92a0-b8664f18ff31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (d03b5a94-89e2-422b-a3cf-b525f487035d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bd911a5c-5fc7-4d4e-a533-4498e6030209 tempest-VolumesSnapshotTestJSON-179613753 None] Created volume successfully. Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-365766b1-9f58-42c1-94fc-0e2651f3eea0-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-365766b1-9f58-42c1-94fc-0e2651f3eea0-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-365766b1-9f58-42c1-94fc-0e2651f3eea0" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-365766b1-9f58-42c1-94fc-0e2651f3eea0" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:35 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[994dcf60-0c84-4e5f-8a6b-c8767ad69749]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:35 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 Jul 06 21:11:35 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:35 devstack sudo[94190]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 1073741824" returned: 0 in 1.761s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:35 devstack sudo[94205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 Jul 06 21:11:35 devstack sudo[94205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:36 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0" returned: 0 in 1.557s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:36 devstack sudo[94226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0 Jul 06 21:11:36 devstack sudo[94226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:36 devstack sudo[94205]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684" returned: 0 in 1.089s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] <== create_volume: return (2946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.955s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22849187-5bb5-4021-9709-20a64159e5d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa0a2d2-4fd4-49ef-8b5d-a11d5c9314ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:37 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Volume volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 (6e03606f-bb3c-4ebe-8b7f-ad9698bd0684): created successfully Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bfa0a2d2-4fd4-49ef-8b5d-a11d5c9314ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Flow 'volume_create_manager' (8696312d-cc88-4d07-aa16-3a6b3fc53b30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:37 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b428efac-6935-4059-8437-957ca2b59e2a tempest-AttachVolumeShelveTestJSON-1497209575 None] Created volume successfully. Jul 06 21:11:37 devstack sudo[94226]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-365766b1-9f58-42c1-94fc-0e2651f3eea0" returned: 0 in 0.855s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-365766b1-9f58-42c1-94fc-0e2651f3eea0" released by "delete_volume" :: held 2.482s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['c9f7f2e0-e7fc-40c0-a778-916c12ca4aca', 'bb8c7195-e854-43c1-a928-42b6e682396d', 'c54fc07f-43be-47aa-a61e-4f1da6ff4474', 'd207ac5b-b83b-426c-9385-6cd2b8356518'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:37 devstack sudo[94233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:11:37 devstack sudo[94233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:38 devstack sudo[94233]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Deleted volume successfully. Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8d0147b4-f1ff-4d35-8413-714e07583c7f tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-365766b1-9f58-42c1-94fc-0e2651f3eea0-delete_volume" released by "delete_volume" :: held 3.414s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-437c83cd-2180-4c0c-817a-d1fb27498d9d-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-437c83cd-2180-4c0c-817a-d1fb27498d9d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-188378be-6a27-481a-9e30-6a3fa30ff9ff" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-188378be-6a27-481a-9e30-6a3fa30ff9ff" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-437c83cd-2180-4c0c-817a-d1fb27498d9d" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-437c83cd-2180-4c0c-817a-d1fb27498d9d" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Deleting offline snapshot 437c83cd-2180-4c0c-817a-d1fb27498d9d of volume 188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] snapshot_file for this snap is: volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[02beaf5a-870b-48f2-afd6-5f3f74f4e9bf]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:38 devstack sudo[94246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d Jul 06 21:11:38 devstack sudo[94246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:39 devstack sudo[94246]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d" returned: 0 in 0.935s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-188378be-6a27-481a-9e30-6a3fa30ff9ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:39 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[acc3c063-707a-4cb1-b37c-4c3b959a7b23]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:39 devstack sudo[94266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff Jul 06 21:11:39 devstack sudo[94266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:40 devstack sudo[94266]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff" returned: 0 in 0.762s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:40 devstack sudo[94271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d Jul 06 21:11:40 devstack sudo[94271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:41 devstack sudo[94271]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d" returned: 0 in 0.785s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:41 devstack sudo[94281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d Jul 06 21:11:41 devstack sudo[94281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:41 devstack sudo[94281]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff.437c83cd-2180-4c0c-817a-d1fb27498d9d" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-437c83cd-2180-4c0c-817a-d1fb27498d9d" released by "_delete_snapshot" :: held 3.299s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-188378be-6a27-481a-9e30-6a3fa30ff9ff" released by "delete_snapshot" :: held 3.331s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:41 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['c695cee5-dd27-4d41-873e-e1fa0c0d42f6', '4121b364-6bdf-4a3a-915c-b94555af705c', 'c8a530b8-01ff-4943-a764-a8e9e15099f9', '76d49e72-ee1f-4764-a18a-4d244f6e3022'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Delete snapshot completed successfully. Jul 06 21:11:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3318300f-2e28-49b4-bf4f-0ac64a49a425 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-437c83cd-2180-4c0c-817a-d1fb27498d9d-delete_snapshot" released by "delete_snapshot" :: held 3.520s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-188378be-6a27-481a-9e30-6a3fa30ff9ff-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-188378be-6a27-481a-9e30-6a3fa30ff9ff-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-188378be-6a27-481a-9e30-6a3fa30ff9ff" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-188378be-6a27-481a-9e30-6a3fa30ff9ff" acquired by "delete_volume" :: waited 0.039s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5928e405-7936-4f04-8da3-106f90f862ca]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:43 devstack sudo[94310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff Jul 06 21:11:43 devstack sudo[94310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:44 devstack sudo[94310]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff" returned: 0 in 1.027s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:44 devstack sudo[94333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff Jul 06 21:11:44 devstack sudo[94333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:45 devstack sudo[94333]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-188378be-6a27-481a-9e30-6a3fa30ff9ff" returned: 0 in 0.833s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-188378be-6a27-481a-9e30-6a3fa30ff9ff" released by "delete_volume" :: held 2.013s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=35,cinder:SELECT=44,cinder:INSERT=11,cinder:DELETE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['70cdf999-4806-4d54-b38f-4ad4642c97b1', '6bb82bf0-8608-417c-90c7-cf3e698bfd1d', '112c08a5-e587-4d94-8453-54cd8697f83a', '81429ced-de02-446d-a948-9f7ef3dc2242'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:45 devstack sudo[94336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:11:45 devstack sudo[94336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:45 devstack sudo[94336]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.780s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:45 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:11:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Deleted volume successfully. Jul 06 21:11:46 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=56,cinder:UPDATE=51,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:11:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de75aa6a-708c-4f40-a1e1-c11b064eb7aa tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-188378be-6a27-481a-9e30-6a3fa30ff9ff-delete_volume" released by "delete_volume" :: held 3.167s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Flow 'volume_create_manager' (a22e66df-7173-4a17-9038-1172d67e8c27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0703ac1c-e91b-4773-a1ab-670a3ef5d4f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0703ac1c-e91b-4773-a1ab-670a3ef5d4f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1320323790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3857164-1245-4803-b084-08fe1bccbf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1079b882d043098ec80fdf7fa6c81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:47Z,use_quota=True,user_id='130315fafd3f4a35833592464a491b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f2b67b-8352-432b-8b22-4c62929723a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (24f2b67b-8352-432b-8b22-4c62929723a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047c0617-89ec-46f3-943b-68aea8a60998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (047c0617-89ec-46f3-943b-68aea8a60998) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e3857164-1245-4803-b084-08fe1bccbf98', 'volume_name': 'volume-e3857164-1245-4803-b084-08fe1bccbf98', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4268683-b9d2-4cf1-bbee-d17b4fa0e6cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4268683-b9d2-4cf1-bbee-d17b4fa0e6cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4a9700-b522-48b7-8d94-9fb2496d9eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Volume e3857164-1245-4803-b084-08fe1bccbf98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e3857164-1245-4803-b084-08fe1bccbf98', 'volume_size': 1} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1320323790',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e3857164-1245-4803-b084-08fe1bccbf98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f1079b882d043098ec80fdf7fa6c81e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:47Z,use_quota=True,user_id='130315fafd3f4a35833592464a491b6d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Creating volume e3857164-1245-4803-b084-08fe1bccbf98 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:47 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:47 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 1073741824 Jul 06 21:11:47 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (8d440a91-90bc-40bb-b057-c3b232e435b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e4be23-eb12-4d23-9cb8-a8e1b9169ef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b5e4be23-eb12-4d23-9cb8-a8e1b9169ef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-947744685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc44b0f6-0063-4d03-aaa4-b1216fb6986a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:47Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f80dd4-00c7-4f5f-8ae1-997f60dcc0fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13f80dd4-00c7-4f5f-8ae1-997f60dcc0fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2798045-3845-433b-8dbd-3d0ccde27ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2798045-3845-433b-8dbd-3d0ccde27ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc44b0f6-0063-4d03-aaa4-b1216fb6986a', 'volume_name': 'volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7b7744-c64b-48a3-b480-892d439c4a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d7b7744-c64b-48a3-b480-892d439c4a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793029dc-943f-4804-8219-532aab8e7253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:47 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Volume cc44b0f6-0063-4d03-aaa4-b1216fb6986a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a', 'volume_size': 1} Jul 06 21:11:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:48 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 1073741824" returned: 0 in 1.014s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:48 devstack sudo[94380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 Jul 06 21:11:48 devstack sudo[94380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:48 devstack sudo[94380]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98" returned: 0 in 0.651s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] <== create_volume: return (1704ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-947744685',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc44b0f6-0063-4d03-aaa4-b1216fb6986a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:47Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Creating volume cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:48 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:11:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd4a9700-b522-48b7-8d94-9fb2496d9eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e3857164-1245-4803-b084-08fe1bccbf98', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:49 devstack sudo[94384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a 1073741824 Jul 06 21:11:49 devstack sudo[94384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a4cc4e-0b9d-4a78-a085-7ddc4410890b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Volume volume-e3857164-1245-4803-b084-08fe1bccbf98 (e3857164-1245-4803-b084-08fe1bccbf98): created successfully Jul 06 21:11:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09a4cc4e-0b9d-4a78-a085-7ddc4410890b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Flow 'volume_create_manager' (a22e66df-7173-4a17-9038-1172d67e8c27) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-122e71f8-fba5-4b8b-9426-3d6957822ef4 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Created volume successfully. Jul 06 21:11:49 devstack sudo[94384]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a 1073741824" returned: 0 in 0.854s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:49 devstack sudo[94391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a Jul 06 21:11:49 devstack sudo[94391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:50 devstack sudo[94391]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:11:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.592s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (793029dc-943f-4804-8219-532aab8e7253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a106720e-debe-4442-8de7-48c6bb1a0272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:50 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Volume volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a (cc44b0f6-0063-4d03-aaa4-b1216fb6986a): created successfully Jul 06 21:11:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a106720e-debe-4442-8de7-48c6bb1a0272) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (8d440a91-90bc-40bb-b057-c3b232e435b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f7745178-e37b-44d0-8ff6-7b4672b365da tempest-VolumesSnapshotTestJSON-179613753 None] Created volume successfully. Jul 06 21:11:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Creating offline snapshot 281266b6-744b-4a03-a592-b3b9b915345e of volume cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:11:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0239ccd0-e16b-4841-b60d-b6fd422e1c3d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:51 devstack sudo[94413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a Jul 06 21:11:51 devstack sudo[94413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:52 devstack sudo[94413]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" returned: 0 in 0.847s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:52 devstack sudo[94423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e 1G Jul 06 21:11:52 devstack sudo[94423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-439c8327-0978-40b4-9fd7-c99b4607b07e tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:53 devstack sudo[94423]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e 1G" returned: 0 in 0.917s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:53 devstack sudo[94437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e Jul 06 21:11:53 devstack sudo[94437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-7a01fa7c-bda6-41d5-a52e-94887f6953ce req-fff4227a-e031-4908-af90-6879768f2f1b tempest-AttachVolumeShelveTestJSON-1497209575 None] No connector for attachment d161ec46-48ac-4263-98da-f58106c92789; skipping storage backend terminate_connection call. {{(pid=87273) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Jul 06 21:11:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-7a01fa7c-bda6-41d5-a52e-94887f6953ce req-fff4227a-e031-4908-af90-6879768f2f1b tempest-AttachVolumeShelveTestJSON-1497209575 None] Deleting attachment d161ec46-48ac-4263-98da-f58106c92789. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:11:54 devstack sudo[94437]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e" returned: 0 in 0.845s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:54 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e is being set with open permissions: ugo+rw Jul 06 21:11:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:54 devstack sudo[94443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e Jul 06 21:11:54 devstack sudo[94443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:55 devstack sudo[94443]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e" returned: 0 in 0.875s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:55 devstack sudo[94447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.info Jul 06 21:11:55 devstack sudo[94447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:55 devstack sudo[94447]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.info" returned: 0 in 0.697s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:55 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.info is being set with open permissions: ugo+rw Jul 06 21:11:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:55 devstack sudo[94458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.info Jul 06 21:11:55 devstack sudo[94458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:56 devstack sudo[94458]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.info" returned: 0 in 0.762s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.061s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-439c8327-0978-40b4-9fd7-c99b4607b07e tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.362s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[aef929be-a9da-4adb-95bd-e34acdaa9dd7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-439c8327-0978-40b4-9fd7-c99b4607b07e tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-36ede004-5a38-4cf1-9f68-0ed644783a82 tempest-VolumesSnapshotTestJSON-179613753 None] Create snapshot completed successfully Jul 06 21:11:56 devstack sudo[94465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 Jul 06 21:11:56 devstack sudo[94465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:57 devstack sudo[94465]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-439c8327-0978-40b4-9fd7-c99b4607b07e tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98" returned: 0 in 0.849s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-439c8327-0978-40b4-9fd7-c99b4607b07e tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.872s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-439c8327-0978-40b4-9fd7-c99b4607b07e tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-e3857164-1245-4803-b084-08fe1bccbf98', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '2ab6c208-4fc4-4483-8d05-c3e3ab786110', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:11:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-439c8327-0978-40b4-9fd7-c99b4607b07e tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] attachment_update completed successfully. Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (4e185c6d-2959-41a6-9d3e-eb5879683fc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5566c441-cb83-47c9-b6e1-e9fd5706a922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5566c441-cb83-47c9-b6e1-e9fd5706a922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:11:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-393901718',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1a9fc4cc-c9bc-4406-8a5d-51bafef814de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2ea4f29e5824259a94043d08af05db0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:11:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=281266b6-744b-4a03-a592-b3b9b915345e,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:11:58Z,use_quota=True,user_id='5d62a99ce2634ba9a32a6a91d788284a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1a7e39-568a-4c25-bf86-2b2611805b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1a7e39-568a-4c25-bf86-2b2611805b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4343f41-8959-457d-b4b1-794cb090a2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4343f41-8959-457d-b4b1-794cb090a2ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '1a9fc4cc-c9bc-4406-8a5d-51bafef814de', 'volume_name': 'volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de', 'volume_size': 1, 'snapshot_id': '281266b6-744b-4a03-a592-b3b9b915345e'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5d92c3-0a5d-407f-a327-27360d88bfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df5d92c3-0a5d-407f-a327-27360d88bfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b937339-c307-4c6f-bb63-033e8c49c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:11:58 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Volume 1a9fc4cc-c9bc-4406-8a5d-51bafef814de: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de', 'volume_size': 1, 'snapshot_id': '281266b6-744b-4a03-a592-b3b9b915345e'} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-281266b6-744b-4a03-a592-b3b9b915345e-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-281266b6-744b-4a03-a592-b3b9b915345e-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Creating volume 1a9fc4cc-c9bc-4406-8a5d-51bafef814de from snapshot 281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] snapshot: 281266b6-744b-4a03-a592-b3b9b915345e, volume: 1a9fc4cc-c9bc-4406-8a5d-51bafef814de, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d513d3af-c98f-4576-a436-c22cb1df10f1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-d75c4cd8-f043-45af-b3a5-a3388fa95546 req-28a8dcc4-2f20-4319-a734-8d611c82b93d tempest-AttachVolumeTestJSON-697008879 None] Terminate volume connection completed successfully. Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-d75c4cd8-f043-45af-b3a5-a3388fa95546 req-28a8dcc4-2f20-4319-a734-8d611c82b93d tempest-AttachVolumeTestJSON-697008879 None] Deleting attachment 25404ee1-aed5-4f21-9ae9-891519ac851b. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:11:58 devstack sudo[94476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e Jul 06 21:11:58 devstack sudo[94476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:11:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-af614e20-3333-4f30-9392-5d23e5082409 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Terminate volume connection completed successfully. Jul 06 21:11:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-2ca9c134-5f85-421b-933d-2cbd62669604 req-af614e20-3333-4f30-9392-5d23e5082409 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Deleting attachment 2ab6c208-4fc4-4483-8d05-c3e3ab786110. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:11:59 devstack sudo[94476]: pam_unix(sudo:session): session closed for user root Jul 06 21:11:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e" returned: 0 in 0.881s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:11:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:11:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:11:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:11:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d3ad45-72f3-4639-9aa8-2cae16aa5f2f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:11:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:11:59 devstack sudo[94485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a Jul 06 21:11:59 devstack sudo[94485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:00 devstack sudo[94485]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" returned: 0 in 0.835s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:00 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:12:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:00 devstack sudo[94490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de Jul 06 21:12:00 devstack sudo[94490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:12:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:01 devstack sudo[94504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:12:01 devstack sudo[94504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:03 devstack sudo[94504]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 2.362s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:03 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:03 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:12:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:12:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:12:06 devstack sudo[94490]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" returned: 0 in 6.040s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:06 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a5f593-e320-4372-9fd9-6f1c30efa9b2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:06 devstack sudo[94512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a Jul 06 21:12:06 devstack sudo[94512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:07 devstack sudo[94512]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" returned: 0 in 0.929s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a, size 1024.00 MB, duration 6.04 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:12:07 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Converted 1024.00 MB image at 169.47 MB/s Jul 06 21:12:07 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de is being set with open permissions: ugo+rw Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:07 devstack sudo[94517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de Jul 06 21:12:07 devstack sudo[94517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:07 devstack sudo[94517]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" returned: 0 in 0.692s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" released by "_copy_volume_from_snapshot" :: held 9.507s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-281266b6-744b-4a03-a592-b3b9b915345e-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" released by "_create_volume_from_snapshot" :: held 9.543s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.561s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b937339-c307-4c6f-bb63-033e8c49c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de', 'volume_size': 1, 'snapshot_id': '281266b6-744b-4a03-a592-b3b9b915345e'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d07a54b-f90d-4f77-8d5c-e99ab375cbb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Volume volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de (1a9fc4cc-c9bc-4406-8a5d-51bafef814de): created successfully Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d07a54b-f90d-4f77-8d5c-e99ab375cbb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Flow 'volume_create_manager' (4e185c6d-2959-41a6-9d3e-eb5879683fc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f0904c79-fa64-4d68-a35d-7c1e17c2bc66 tempest-VolumesSnapshotTestJSON-179613753 None] Created volume successfully. Jul 06 21:12:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-1a9fc4cc-c9bc-4406-8a5d-51bafef814de-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-1a9fc4cc-c9bc-4406-8a5d-51bafef814de-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:08 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3448387-c436-4ee7-b090-9404efd90dfe]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:08 devstack sudo[94522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de Jul 06 21:12:08 devstack sudo[94522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:09 devstack sudo[94522]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" returned: 0 in 0.751s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:09 devstack sudo[94539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de Jul 06 21:12:09 devstack sudo[94539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:09 devstack sudo[94539]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" returned: 0 in 0.807s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-1a9fc4cc-c9bc-4406-8a5d-51bafef814de" released by "delete_volume" :: held 1.612s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['5fe50adf-51cb-440c-9fa2-32705a3bb7fb', '0770acb4-f4a8-423a-8d25-ce9123d761e3', 'f726c351-3b7d-423a-8d44-e22921fa0c98', 'db98c3fe-e0d2-4e3a-990d-22c147d1e9b2'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:10 devstack sudo[94572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:12:10 devstack sudo[94572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-281266b6-744b-4a03-a592-b3b9b915345e-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-281266b6-744b-4a03-a592-b3b9b915345e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-281266b6-744b-4a03-a592-b3b9b915345e" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-281266b6-744b-4a03-a592-b3b9b915345e" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Deleting offline snapshot 281266b6-744b-4a03-a592-b3b9b915345e of volume cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] snapshot_file for this snap is: volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3dc04870-c468-490f-a308-3c0554e28be6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:10 devstack sudo[94572]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:10 devstack sudo[94584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e Jul 06 21:12:10 devstack sudo[94584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:10 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Deleted volume successfully. Jul 06 21:12:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16cbf1a3-fd04-4867-8c62-bc6d1ef069c1 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-1a9fc4cc-c9bc-4406-8a5d-51bafef814de-delete_volume" released by "delete_volume" :: held 2.619s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:11 devstack sudo[94584]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e" returned: 0 in 0.816s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:12:11 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[03795c1c-8bba-45c9-8e48-58de8ee6d749]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:11 devstack sudo[94599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a Jul 06 21:12:11 devstack sudo[94599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:12 devstack sudo[94599]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:12 devstack sudo[94618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e Jul 06 21:12:12 devstack sudo[94618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:13 devstack sudo[94618]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e" returned: 0 in 1.364s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:13 devstack sudo[94680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e Jul 06 21:12:13 devstack sudo[94680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:15 devstack sudo[94680]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a.281266b6-744b-4a03-a592-b3b9b915345e" returned: 0 in 1.377s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-281266b6-744b-4a03-a592-b3b9b915345e" released by "_delete_snapshot" :: held 4.501s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" released by "delete_snapshot" :: held 4.538s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:15 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['580df527-d908-42c9-89af-45503faf8417', '5807651c-1753-4cc3-a1fd-83035d66df87', '3ae50331-e036-4865-87f7-d9b56b354be9', 'c2ecb8d9-b1d9-4328-9f6d-42d689f6b9a1'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:15 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Delete snapshot completed successfully. Jul 06 21:12:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5961d5-64bc-4e44-8893-6b3e25e03e54 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-281266b6-744b-4a03-a592-b3b9b915345e-delete_snapshot" released by "delete_snapshot" :: held 4.702s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-cc44b0f6-0063-4d03-aaa4-b1216fb6986a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-cc44b0f6-0063-4d03-aaa4-b1216fb6986a-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:16 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3643da66-8d7d-4d20-bc8a-5628db4af872]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:16 devstack sudo[94744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a Jul 06 21:12:16 devstack sudo[94744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:17 devstack sudo[94744]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" returned: 0 in 0.901s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:17 devstack sudo[94752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a Jul 06 21:12:17 devstack sudo[94752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:17 devstack sudo[94752]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" returned: 0 in 0.819s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-cc44b0f6-0063-4d03-aaa4-b1216fb6986a" released by "delete_volume" :: held 1.840s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['8bfb5973-3ccf-427d-9564-377509450760', '51a2ceb9-bb56-432c-a3cb-94873b802fcb', '2c521697-4f86-403f-90e9-3c5e78a1d3dd', '97731568-f585-4c42-8b4a-233bb371cb2f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:18 devstack sudo[94756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:12:18 devstack sudo[94756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-36a11bcb-9848-4855-b38f-a486f134033c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-36a11bcb-9848-4855-b38f-a486f134033c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "cinder-quobyte-36a11bcb-9848-4855-b38f-a486f134033c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-36a11bcb-9848-4855-b38f-a486f134033c" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[00fbb620-0cde-4a41-8b68-a3db8f1fc63c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:18 devstack sudo[94758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c Jul 06 21:12:18 devstack sudo[94758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:19 devstack sudo[94756]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.129s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:19 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Deleted volume successfully. Jul 06 21:12:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7633d829-bc17-42c9-b796-66b1fbc470e5 tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-cc44b0f6-0063-4d03-aaa4-b1216fb6986a-delete_volume" released by "delete_volume" :: held 3.249s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:19 devstack sudo[94758]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c" returned: 0 in 1.011s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:19 devstack sudo[94764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c Jul 06 21:12:19 devstack sudo[94764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:20 devstack sudo[94764]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-36a11bcb-9848-4855-b38f-a486f134033c" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-quobyte-36a11bcb-9848-4855-b38f-a486f134033c" released by "delete_volume" :: held 1.769s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Created reservations ['e3c567b2-9108-49c0-bb3e-1a4602380888', '29ef07c6-ae51-410c-a23a-568b1c8e6f72', '82db1c2c-f271-4a71-a933-c0152ba7101e', 'f3f7d46a-8116-49ad-af3d-6c05780d521a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:20 devstack sudo[94767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:12:20 devstack sudo[94767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:21 devstack sudo[94767]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.740s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:21 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Deleted volume successfully. Jul 06 21:12:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9c071992-0ac9-4cb5-a354-3be57729f61b tempest-VolumesSnapshotTestJSON-179613753 None] Lock "cinder-36a11bcb-9848-4855-b38f-a486f134033c-delete_volume" released by "delete_volume" :: held 2.767s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Flow 'volume_create_manager' (df6db733-9cb0-4178-9aa0-b50b01153908) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d3b981-b765-4cd0-a4f6-47f949343c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58d3b981-b765-4cd0-a4f6-47f949343c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c95548e-de57-47e9-a0e3-8eac70054e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48030c045c144889ec3f49434ea7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:27Z,use_quota=True,user_id='c1e85c83e7ee42838763c16e98721e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a241b9-6274-4b26-82f8-4caed3f766b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88a241b9-6274-4b26-82f8-4caed3f766b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe62bac2-199f-4c12-8934-f2374d6c2e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fe62bac2-199f-4c12-8934-f2374d6c2e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2c95548e-de57-47e9-a0e3-8eac70054e3a', 'volume_name': 'volume-2c95548e-de57-47e9-a0e3-8eac70054e3a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd136c22-03b1-49b1-8e36-9b2b42bed747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd136c22-03b1-49b1-8e36-9b2b42bed747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dc0cb9-34b5-4e6a-bceb-42c18da4f18e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:27 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Volume 2c95548e-de57-47e9-a0e3-8eac70054e3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2c95548e-de57-47e9-a0e3-8eac70054e3a', 'volume_size': 1} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:27Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c95548e-de57-47e9-a0e3-8eac70054e3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48030c045c144889ec3f49434ea7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:27Z,use_quota=True,user_id='c1e85c83e7ee42838763c16e98721e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Creating volume 2c95548e-de57-47e9-a0e3-8eac70054e3a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:27 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:12:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:27 devstack sudo[94781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a 1073741824 Jul 06 21:12:27 devstack sudo[94781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:28 devstack sudo[94781]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a 1073741824" returned: 0 in 0.869s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:28 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a Jul 06 21:12:28 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:29 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a" returned: 0 in 0.736s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] <== create_volume: return (1654ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:12:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.659s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dc0cb9-34b5-4e6a-bceb-42c18da4f18e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c95548e-de57-47e9-a0e3-8eac70054e3a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f193beb-1865-443e-ac2a-e07f0a65d654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:29 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Volume volume-2c95548e-de57-47e9-a0e3-8eac70054e3a (2c95548e-de57-47e9-a0e3-8eac70054e3a): created successfully Jul 06 21:12:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f193beb-1865-443e-ac2a-e07f0a65d654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Flow 'volume_create_manager' (df6db733-9cb0-4178-9aa0-b50b01153908) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:29 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bb051aca-ab03-4974-88e5-601c144763af tempest-CinderUnicodeTest-3712471 None] Created volume successfully. Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Flow 'volume_create_manager' (bc187b85-5b73-483b-96e6-677dbec69687) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad0ad25-813c-44aa-8a9c-e64132eeb02d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad0ad25-813c-44aa-8a9c-e64132eeb02d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-454072033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ffeba1-5391-4e4e-93ee-5fea9b87852e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48030c045c144889ec3f49434ea7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:30Z,use_quota=True,user_id='c1e85c83e7ee42838763c16e98721e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba47389-db8c-4011-ba83-6174e01eb11f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ba47389-db8c-4011-ba83-6174e01eb11f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805917ff-f452-4881-b86e-e4fcc2614b58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805917ff-f452-4881-b86e-e4fcc2614b58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72ffeba1-5391-4e4e-93ee-5fea9b87852e', 'volume_name': 'volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db60fa8b-6b56-493d-82d4-ffd42e40654f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db60fa8b-6b56-493d-82d4-ffd42e40654f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46aead0-eeaa-4481-bb15-43a290597cc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Volume 72ffeba1-5391-4e4e-93ee-5fea9b87852e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e', 'volume_size': 1} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:30Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-454072033',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72ffeba1-5391-4e4e-93ee-5fea9b87852e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a48030c045c144889ec3f49434ea7de4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:30Z,use_quota=True,user_id='c1e85c83e7ee42838763c16e98721e2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Creating volume 72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:30 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:30 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e 1073741824 Jul 06 21:12:30 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:30 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e 1073741824" returned: 0 in 0.853s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:31 devstack sudo[94796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e Jul 06 21:12:31 devstack sudo[94796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:31 devstack sudo[94796]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e" returned: 0 in 0.632s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] <== create_volume: return (1529ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:12:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d46aead0-eeaa-4481-bb15-43a290597cc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b86c6f-c25f-43fd-baaa-66b170489e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:31 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Volume volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e (72ffeba1-5391-4e4e-93ee-5fea9b87852e): created successfully Jul 06 21:12:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (01b86c6f-c25f-43fd-baaa-66b170489e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Flow 'volume_create_manager' (bc187b85-5b73-483b-96e6-677dbec69687) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-300d3d50-bfce-4004-96e7-ae59d13e9625 tempest-CinderUnicodeTest-3712471 None] Created volume successfully. Jul 06 21:12:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Creating offline snapshot 0644fe53-6708-47ba-a799-759cd90716d8 of volume 72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:12:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a22aab50-0aeb-40c5-a356-c04e596cdbd7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:32 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e Jul 06 21:12:32 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:33 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e" returned: 0 in 0.780s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:33 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 1G Jul 06 21:12:33 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:33 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 1G" returned: 0 in 0.744s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:33 devstack sudo[94809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 Jul 06 21:12:33 devstack sudo[94809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:34 devstack sudo[94809]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8" returned: 0 in 0.752s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:34 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 is being set with open permissions: ugo+rw Jul 06 21:12:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:34 devstack sudo[94814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 Jul 06 21:12:34 devstack sudo[94814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:35 devstack sudo[94814]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:35 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.info Jul 06 21:12:35 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:36 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.info" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:36 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.info is being set with open permissions: ugo+rw Jul 06 21:12:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:36 devstack sudo[94822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.info Jul 06 21:12:36 devstack sudo[94822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:36 devstack sudo[94822]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.info" returned: 0 in 0.714s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.474s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-78442f50-cdc1-41ec-80a0-1679f2c7294f tempest-CinderUnicodeTest-3712471 None] Create snapshot completed successfully Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Acquiring lock "cinder-0644fe53-6708-47ba-a799-759cd90716d8-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Lock "cinder-0644fe53-6708-47ba-a799-759cd90716d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Acquiring lock "cinder-quobyte-72ffeba1-5391-4e4e-93ee-5fea9b87852e" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-72ffeba1-5391-4e4e-93ee-5fea9b87852e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Acquiring lock "cinder-quobyte-0644fe53-6708-47ba-a799-759cd90716d8" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-0644fe53-6708-47ba-a799-759cd90716d8" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Deleting offline snapshot 0644fe53-6708-47ba-a799-759cd90716d8 of volume 72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] snapshot_file for this snap is: volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c9a01c2d-55b2-4b6f-abdc-e82f373123fe]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:37 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 Jul 06 21:12:37 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:38 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8" returned: 0 in 0.842s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:12:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5f9aa27-b938-4b61-ab3f-8f9ec947e0b3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:38 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e Jul 06 21:12:38 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:39 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e" returned: 0 in 0.834s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:39 devstack sudo[94847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 Jul 06 21:12:39 devstack sudo[94847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:40 devstack sudo[94847]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8" returned: 0 in 1.063s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:40 devstack sudo[94889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8 Jul 06 21:12:40 devstack sudo[94889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:41 devstack sudo[94889]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e.0644fe53-6708-47ba-a799-759cd90716d8" returned: 0 in 0.725s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-0644fe53-6708-47ba-a799-759cd90716d8" released by "_delete_snapshot" :: held 3.613s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-72ffeba1-5391-4e4e-93ee-5fea9b87852e" released by "delete_snapshot" :: held 3.642s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Created reservations ['2251f85a-ac2e-4109-8e56-1df89e3308b3', '863ef5a4-c5cd-468d-b6e3-411b6f09d959', '689dcecc-ef1b-45a1-8c44-06f66ca3191f', '8bacbcc5-51e2-4944-b1bb-e0bb9eef4a49'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Delete snapshot completed successfully. Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce588a03-6979-48fe-827d-d6de56d58a5c tempest-CinderUnicodeTest-3712471 None] Lock "cinder-0644fe53-6708-47ba-a799-759cd90716d8-delete_snapshot" released by "delete_snapshot" :: held 3.986s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Acquiring lock "cinder-72ffeba1-5391-4e4e-93ee-5fea9b87852e-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Lock "cinder-72ffeba1-5391-4e4e-93ee-5fea9b87852e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Acquiring lock "cinder-quobyte-72ffeba1-5391-4e4e-93ee-5fea9b87852e" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-72ffeba1-5391-4e4e-93ee-5fea9b87852e" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2ce5c00-fa89-45a1-b6ce-d314eeef0509]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:42 devstack sudo[94914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e Jul 06 21:12:42 devstack sudo[94914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:42 devstack sudo[94914]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e" returned: 0 in 0.812s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:42 devstack sudo[94922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e Jul 06 21:12:42 devstack sudo[94922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:43 devstack sudo[94922]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-72ffeba1-5391-4e4e-93ee-5fea9b87852e" returned: 0 in 0.725s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-72ffeba1-5391-4e4e-93ee-5fea9b87852e" released by "delete_volume" :: held 1.609s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Created reservations ['7a463c37-568c-4047-9d77-29c71a38acc4', 'e5391d05-856d-4b4e-bec1-e5eedfaf41e5', '0626f493-36cd-4423-9c8d-06cc02c32f60', '48770d29-7dfc-41d7-93d5-512e7fefb1b6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:43 devstack sudo[94926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:12:43 devstack sudo[94926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Acquiring lock "cinder-2c95548e-de57-47e9-a0e3-8eac70054e3a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Lock "cinder-2c95548e-de57-47e9-a0e3-8eac70054e3a-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Acquiring lock "cinder-quobyte-2c95548e-de57-47e9-a0e3-8eac70054e3a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-2c95548e-de57-47e9-a0e3-8eac70054e3a" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a0d8dd-943e-493c-869f-bb56cc8ad8be]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:44 devstack sudo[94964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a Jul 06 21:12:44 devstack sudo[94964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:44 devstack sudo[94926]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.769s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Deleted volume successfully. Jul 06 21:12:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-217541d5-1ce6-439e-8b0c-0f69116202e0 tempest-CinderUnicodeTest-3712471 None] Lock "cinder-72ffeba1-5391-4e4e-93ee-5fea9b87852e-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:45 devstack sudo[94964]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a" returned: 0 in 0.841s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:45 devstack sudo[94970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a Jul 06 21:12:45 devstack sudo[94970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:45 devstack sudo[94970]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2c95548e-de57-47e9-a0e3-8eac70054e3a" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Lock "cinder-quobyte-2c95548e-de57-47e9-a0e3-8eac70054e3a" released by "delete_volume" :: held 1.547s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:INSERT=18,cinder:UPDATE=75,cinder:SELECT=60,cinder:DELETE=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Created reservations ['92e412af-86ff-4baa-aaba-c6e6a150d263', '64c9320b-e928-43a7-b490-e567b0a31d66', 'ce66ba51-db6a-42a4-a02e-bee08712b3a6', 'c79cff1b-85ad-407b-a03c-cbbb65776fbd'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:45 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:12:45 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:46 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.665s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:46 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Deleted volume successfully. Jul 06 21:12:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-79f00521-8148-4e7d-8443-b4c9c2fdadff tempest-CinderUnicodeTest-3712471 None] Lock "cinder-2c95548e-de57-47e9-a0e3-8eac70054e3a-delete_volume" released by "delete_volume" :: held 2.439s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Acquiring lock "cinder-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "cinder-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:48 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=65,cinder:SELECT=64,cinder:DELETE=9,cinder:INSERT=14 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:12:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Acquiring lock "cinder-quobyte-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:12:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "cinder-quobyte-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684" acquired by "delete_volume" :: waited 0.037s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:12:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee04764-16be-48ab-b809-b7c251572f0f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:12:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:48 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 Jul 06 21:12:48 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:49 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684" returned: 0 in 0.863s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:49 devstack sudo[94996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684 Jul 06 21:12:49 devstack sudo[94996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:50 devstack sudo[94996]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "cinder-quobyte-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684" released by "delete_volume" :: held 1.613s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Created reservations ['a1f6e3d0-0618-4aa7-95d1-4402bc07c58c', '80370da2-80da-448b-81b0-2cdf96e5e8b7', 'd7b43655-df74-44dc-b6fd-09b39b4ba38e', '2bf96822-9395-40fc-a36a-7949e0fd9952'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:50 devstack sudo[95002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:12:50 devstack sudo[95002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:12:51 devstack sudo[95002]: pam_unix(sudo:session): session closed for user root Jul 06 21:12:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.708s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:12:51 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:12:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Deleted volume successfully. Jul 06 21:12:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a99618c8-bc90-4df1-aa93-5f4a2cdbaf85 tempest-AttachVolumeShelveTestJSON-1497209575 None] Lock "cinder-6e03606f-bb3c-4ebe-8b7f-ad9698bd0684-delete_volume" released by "delete_volume" :: held 2.664s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:12:58 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Flow 'volume_create_manager' (c6e20340-1c30-41d3-a9f8-8f23e8dbfcc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cba999-14f2-49bd-bf8c-ebad0be403a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (45cba999-14f2-49bd-bf8c-ebad0be403a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2037157339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8b1174-c69d-4b07-97cd-3b13776b10cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a5efe0b85b4569abe5fd8d2529f1b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:59Z,use_quota=True,user_id='21ad0a09377a42aabfb4545cf7cfe469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89609cae-c78a-4aa3-ad76-14483250874f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89609cae-c78a-4aa3-ad76-14483250874f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dae61d-a04e-4cb0-a734-5fba53a75837) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3dae61d-a04e-4cb0-a734-5fba53a75837) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa8b1174-c69d-4b07-97cd-3b13776b10cd', 'volume_name': 'volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3155daa-829e-4cd7-9447-34f7629d1e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3155daa-829e-4cd7-9447-34f7629d1e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8588ffdd-60cd-4ad9-af78-e6b21a62ca06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:12:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Volume fa8b1174-c69d-4b07-97cd-3b13776b10cd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd', 'volume_size': 1} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:12:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-2037157339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa8b1174-c69d-4b07-97cd-3b13776b10cd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='51a5efe0b85b4569abe5fd8d2529f1b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:12:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:12:59Z,use_quota=True,user_id='21ad0a09377a42aabfb4545cf7cfe469',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Creating volume fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:12:59 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:12:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:12:59 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd 1073741824 Jul 06 21:12:59 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:00 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd 1073741824" returned: 0 in 1.121s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:00 devstack sudo[95042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd Jul 06 21:13:00 devstack sudo[95042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:01 devstack sudo[95075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:13:01 devstack sudo[95075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:01 devstack sudo[95042]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd" returned: 0 in 0.921s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] <== create_volume: return (2151ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.153s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8588ffdd-60cd-4ad9-af78-e6b21a62ca06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2567c5-4a42-4cf5-9206-c2f11ea2d704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:01 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Volume volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd (fa8b1174-c69d-4b07-97cd-3b13776b10cd): created successfully Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f2567c5-4a42-4cf5-9206-c2f11ea2d704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Flow 'volume_create_manager' (c6e20340-1c30-41d3-a9f8-8f23e8dbfcc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:01 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-188adf27-d01d-44e3-bbb0-37651932942e req-b3dd2098-5431-4356-b5d1-911a2878cca7 tempest-VolumesSnapshotsTestJSON-1396898423 None] Created volume successfully. Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Creating offline snapshot 2497424b-9f9b-4d98-8907-89dcb304aeb8 of volume fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad235024-cc2f-40dd-8e44-8190f9475991]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:02 devstack sudo[95092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd Jul 06 21:13:02 devstack sudo[95092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:02 devstack sudo[95075]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.245s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:13:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:13:03 devstack sudo[95092]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd" returned: 0 in 1.307s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:03 devstack sudo[95118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 1G Jul 06 21:13:03 devstack sudo[95118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:04 devstack sudo[95118]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 1G" returned: 0 in 1.305s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:04 devstack sudo[95128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 Jul 06 21:13:04 devstack sudo[95128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:05 devstack sudo[95128]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8" returned: 0 in 1.220s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:05 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 is being set with open permissions: ugo+rw Jul 06 21:13:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:05 devstack sudo[95134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 Jul 06 21:13:05 devstack sudo[95134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:06 devstack sudo[95134]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8" returned: 0 in 0.910s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:06 devstack sudo[95137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.info Jul 06 21:13:06 devstack sudo[95137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:07 devstack sudo[95137]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.info" returned: 0 in 0.971s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:07 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.info is being set with open permissions: ugo+rw Jul 06 21:13:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:07 devstack sudo[95140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.info Jul 06 21:13:07 devstack sudo[95140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:08 devstack sudo[95140]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.info" returned: 0 in 0.872s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 6.766s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-89cd6e1c-5891-4adf-8778-4c209960c560 req-7acdd873-5fdb-494d-a2ea-f709dd628567 tempest-VolumesSnapshotsTestJSON-1396898423 None] Create snapshot completed successfully Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "cinder-2497424b-9f9b-4d98-8907-89dcb304aeb8-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-2497424b-9f9b-4d98-8907-89dcb304aeb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "cinder-quobyte-fa8b1174-c69d-4b07-97cd-3b13776b10cd" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-quobyte-fa8b1174-c69d-4b07-97cd-3b13776b10cd" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "cinder-quobyte-2497424b-9f9b-4d98-8907-89dcb304aeb8" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-quobyte-2497424b-9f9b-4d98-8907-89dcb304aeb8" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Deleting offline snapshot 2497424b-9f9b-4d98-8907-89dcb304aeb8 of volume fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] snapshot_file for this snap is: volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1da6860e-014a-4fc4-b2a1-a6a13e793a51]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:09 devstack sudo[95145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 Jul 06 21:13:09 devstack sudo[95145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:10 devstack sudo[95145]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8" returned: 0 in 1.103s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acb2215-8c28-45ca-b6b4-3914939bf54f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:10 devstack sudo[95150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd Jul 06 21:13:10 devstack sudo[95150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:11 devstack sudo[95150]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd" returned: 0 in 0.955s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:11 devstack sudo[95155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 Jul 06 21:13:11 devstack sudo[95155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:12 devstack sudo[95155]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8" returned: 0 in 1.204s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:12 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8 Jul 06 21:13:12 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:13 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd.2497424b-9f9b-4d98-8907-89dcb304aeb8" returned: 0 in 0.983s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-quobyte-2497424b-9f9b-4d98-8907-89dcb304aeb8" released by "_delete_snapshot" :: held 4.413s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-quobyte-fa8b1174-c69d-4b07-97cd-3b13776b10cd" released by "delete_snapshot" :: held 4.448s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:13 devstack cinder-volume[87273]: DEBUG cinder.quota [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Created reservations ['fd89b5d0-627b-474c-b01d-6e38586b5f6e', '13546319-4d40-4f89-a354-881efd1ec9d8', '546fe2eb-19eb-4d12-a1f7-099098de3532', '61da50fe-21e5-441e-9082-942aaee7883b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Delete snapshot completed successfully. Jul 06 21:13:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-12d702b8-736e-4112-8c4b-7cd5d881fc66 req-4728e2bf-3871-4c8a-8863-b93760103793 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-2497424b-9f9b-4d98-8907-89dcb304aeb8-delete_snapshot" released by "delete_snapshot" :: held 4.641s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "cinder-fa8b1174-c69d-4b07-97cd-3b13776b10cd-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-fa8b1174-c69d-4b07-97cd-3b13776b10cd-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "cinder-quobyte-fa8b1174-c69d-4b07-97cd-3b13776b10cd" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-quobyte-fa8b1174-c69d-4b07-97cd-3b13776b10cd" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:14 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd5e98cb-ec90-4a8c-ace1-350722e2966f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:14 devstack sudo[95166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd Jul 06 21:13:14 devstack sudo[95166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:15 devstack sudo[95166]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd" returned: 0 in 0.757s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:15 devstack sudo[95171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd Jul 06 21:13:15 devstack sudo[95171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:16 devstack sudo[95171]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fa8b1174-c69d-4b07-97cd-3b13776b10cd" returned: 0 in 0.748s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-quobyte-fa8b1174-c69d-4b07-97cd-3b13776b10cd" released by "delete_volume" :: held 1.610s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG cinder.quota [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Created reservations ['afcf24e2-494c-4386-9bb8-66c003f6553f', '370f5bc7-c95a-46a2-8f0b-a038635de7ef', '7d0032c7-fe8e-4cfe-aa2d-00fe8b196ac7', 'd1bd94b0-3437-4482-b687-51e79c003201'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:16 devstack sudo[95204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:13:16 devstack sudo[95204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:17 devstack sudo[95204]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:17 devstack cinder-volume[87273]: DEBUG cinder.manager [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Deleted volume successfully. Jul 06 21:13:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-a7b65fa7-d692-491e-978a-2e0a4a17a4bd req-6086c005-d6ce-4997-9245-318944719400 tempest-VolumesSnapshotsTestJSON-1396898423 None] Lock "cinder-fa8b1174-c69d-4b07-97cd-3b13776b10cd-delete_volume" released by "delete_volume" :: held 2.730s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Flow 'volume_create_manager' (cdb82db7-830c-46ee-bd0b-d4c892214fa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5a162f-a480-4dd8-85ae-490b1de8638f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f5a162f-a480-4dd8-85ae-490b1de8638f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-557361737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694586be-3fa0-40d0-aa1f-e69af432f046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea0bce6532e4a5c9dfb9ed2a3f86c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:19Z,use_quota=True,user_id='b00fb0bd89f841ada1767d5a75192658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3337d656-fc33-4c63-8828-70db65f4af2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3337d656-fc33-4c63-8828-70db65f4af2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9bce4f-5d22-4986-96d0-a67052d05c67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c9bce4f-5d22-4986-96d0-a67052d05c67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '694586be-3fa0-40d0-aa1f-e69af432f046', 'volume_name': 'volume-694586be-3fa0-40d0-aa1f-e69af432f046', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6093c0-450e-4e3c-9522-9811c6701de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c6093c0-450e-4e3c-9522-9811c6701de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e3c4c2-2108-4a63-a3d6-04c0e32bee8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:18 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Volume 694586be-3fa0-40d0-aa1f-e69af432f046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-694586be-3fa0-40d0-aa1f-e69af432f046', 'volume_size': 1} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-557361737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=694586be-3fa0-40d0-aa1f-e69af432f046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea0bce6532e4a5c9dfb9ed2a3f86c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:19Z,use_quota=True,user_id='b00fb0bd89f841ada1767d5a75192658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Creating volume 694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:18 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:13:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:18 devstack sudo[95208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 1073741824 Jul 06 21:13:18 devstack sudo[95208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:19 devstack sudo[95208]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 1073741824" returned: 0 in 0.877s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:19 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 Jul 06 21:13:19 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:20 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046" returned: 0 in 0.698s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] <== create_volume: return (1621ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.625s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7e3c4c2-2108-4a63-a3d6-04c0e32bee8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-694586be-3fa0-40d0-aa1f-e69af432f046', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a5a079-77f5-4eed-b90a-7e2de39dba27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Volume volume-694586be-3fa0-40d0-aa1f-e69af432f046 (694586be-3fa0-40d0-aa1f-e69af432f046): created successfully Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16a5a079-77f5-4eed-b90a-7e2de39dba27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Flow 'volume_create_manager' (cdb82db7-830c-46ee-bd0b-d4c892214fa4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3e852e13-1cac-45af-a0ef-c7b6b34e539b tempest-SnapshotDependencyTests-871721768 None] Created volume successfully. Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Creating offline snapshot 90c89972-584c-4412-aa91-ca2c40cba977 of volume 694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b10dc4b-6b9d-4a25-867d-7edaf3521a94]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:21 devstack sudo[95217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 Jul 06 21:13:21 devstack sudo[95217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Flow 'volume_create_manager' (3c382ac5-6efc-4978-b622-bd9be5083ceb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a2ee3b-40d8-4d6e-8439-ef473b1673a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77a2ee3b-40d8-4d6e-8439-ef473b1673a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1551302897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bfb43f90fe24bd5b4069ea692968ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:21Z,use_quota=True,user_id='2202283ebb13447db72f5b0dfb7f0846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaf783a-70a0-498b-be09-0b2d53b6ef43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcaf783a-70a0-498b-be09-0b2d53b6ef43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dba3771-b78b-484f-ad32-bbfa80bc577f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dba3771-b78b-484f-ad32-bbfa80bc577f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d', 'volume_name': 'volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341c7c40-7da0-40f0-9eae-8e06439d2697) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (341c7c40-7da0-40f0-9eae-8e06439d2697) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a0e9a6-574d-4a74-a17e-e30ae28ea751) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:21 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Volume 9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d', 'volume_size': 1} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:21 devstack sudo[95217]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046" returned: 0 in 0.753s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:21 devstack sudo[95222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 1G Jul 06 21:13:21 devstack sudo[95222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:22 devstack sudo[95222]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 1G" returned: 0 in 0.830s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694586be-3fa0-40d0-aa1f-e69af432f046 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:22 devstack sudo[95228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694586be-3fa0-40d0-aa1f-e69af432f046 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 Jul 06 21:13:22 devstack sudo[95228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:23 devstack sudo[95228]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-694586be-3fa0-40d0-aa1f-e69af432f046 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977" returned: 0 in 0.639s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:23 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 is being set with open permissions: ugo+rw Jul 06 21:13:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:23 devstack sudo[95233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 Jul 06 21:13:23 devstack sudo[95233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:23 devstack sudo[95233]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977" returned: 0 in 0.673s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:23 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.info Jul 06 21:13:23 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:24 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.info" returned: 0 in 0.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:24 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.info is being set with open permissions: ugo+rw Jul 06 21:13:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:24 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.info Jul 06 21:13:24 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:25 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.info" returned: 0 in 0.614s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.321s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.829s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1551302897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='0bfb43f90fe24bd5b4069ea692968ac3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:21Z,use_quota=True,user_id='2202283ebb13447db72f5b0dfb7f0846',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Creating volume 9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:25 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:13:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:25 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d 1073741824 Jul 06 21:13:25 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-717e42a9-774f-4079-8d22-619c60366bf9 tempest-SnapshotDependencyTests-871721768 None] Create snapshot completed successfully Jul 06 21:13:26 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d 1073741824" returned: 0 in 0.862s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:26 devstack sudo[95248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d Jul 06 21:13:26 devstack sudo[95248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:26 devstack sudo[95248]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d" returned: 0 in 0.648s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] <== create_volume: return (1562ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.565s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Flow 'volume_create_manager' (17869625-4c5c-4e24-9586-53db047cb255) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5503fb88-25cb-4349-9660-cd1901eb9ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5503fb88-25cb-4349-9660-cd1901eb9ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:26Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af737251-0d11-451d-88d7-c4611a4d7785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5ea0bce6532e4a5c9dfb9ed2a3f86c7a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=90c89972-584c-4412-aa91-ca2c40cba977,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:27Z,use_quota=True,user_id='b00fb0bd89f841ada1767d5a75192658',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c8744a-548d-45e1-8864-3412d09d1c96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23c8744a-548d-45e1-8864-3412d09d1c96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f46b29-b9d5-479d-9c3f-c4fdc58e77a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40f46b29-b9d5-479d-9c3f-c4fdc58e77a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'af737251-0d11-451d-88d7-c4611a4d7785', 'volume_name': 'volume-af737251-0d11-451d-88d7-c4611a4d7785', 'volume_size': 1, 'snapshot_id': '90c89972-584c-4412-aa91-ca2c40cba977'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc2553d-fdca-4211-90c4-b2a5ba8cb60c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0cc2553d-fdca-4211-90c4-b2a5ba8cb60c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc83946-1e33-4d3c-8cc6-218290ca0236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:26 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Volume af737251-0d11-451d-88d7-c4611a4d7785: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-af737251-0d11-451d-88d7-c4611a4d7785', 'volume_size': 1, 'snapshot_id': '90c89972-584c-4412-aa91-ca2c40cba977'} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6a0e9a6-574d-4a74-a17e-e30ae28ea751) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9612bd6c-4d2d-4dcc-976d-27d9cde5082b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-quobyte-90c89972-584c-4412-aa91-ca2c40cba977-af737251-0d11-451d-88d7-c4611a4d7785" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:26 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Volume volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d (9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d): created successfully Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9612bd6c-4d2d-4dcc-976d-27d9cde5082b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Flow 'volume_create_manager' (3c382ac5-6efc-4978-b622-bd9be5083ceb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-90c89972-584c-4412-aa91-ca2c40cba977-af737251-0d11-451d-88d7-c4611a4d7785" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Creating volume af737251-0d11-451d-88d7-c4611a4d7785 from snapshot 90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-quobyte-af737251-0d11-451d-88d7-c4611a4d7785" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-fbbca7ec-f432-4d70-a7d8-f83d8f66bd8a req-2e4ce6ee-b521-43f5-99fa-78f7dc41b5b2 tempest-VolumesGetTestJSON-770886402 None] Created volume successfully. Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-af737251-0d11-451d-88d7-c4611a4d7785" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] snapshot: 90c89972-584c-4412-aa91-ca2c40cba977, volume: af737251-0d11-451d-88d7-c4611a4d7785, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d756491a-cc23-4a4d-86af-d06781229cc8]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:27 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 Jul 06 21:13:27 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:27 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977" returned: 0 in 0.735s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694586be-3fa0-40d0-aa1f-e69af432f046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf53c5c9-b8a4-4837-b81c-ee785769d02f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:27 devstack sudo[95257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 Jul 06 21:13:27 devstack sudo[95257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Acquiring lock "cinder-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Lock "cinder-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Acquiring lock "cinder-quobyte-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Lock "cinder-quobyte-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b078600c-74a8-478c-a7b7-f9e4658fb37b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:28 devstack sudo[95261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d Jul 06 21:13:28 devstack sudo[95261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:28 devstack sudo[95257]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046" returned: 0 in 0.846s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:28 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 Jul 06 21:13:28 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Flow 'volume_create_manager' (aaacc642-97e5-4043-b8ca-4b531803492a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e4a117-dc01-499c-9f20-1135b3be689b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f8e4a117-dc01-499c-9f20-1135b3be689b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-144469440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b03588d-b9d8-49d8-8146-7f9d58a1bf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27100f871ea48bf9be7b8e276f68309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:29Z,use_quota=True,user_id='2736151ce4c24fa487024b2b3a7b0e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd154682-cb14-465d-861c-df854a0e192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd154682-cb14-465d-861c-df854a0e192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e1dea0-db09-4623-8ca1-5b35e6a05db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1e1dea0-db09-4623-8ca1-5b35e6a05db6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b03588d-b9d8-49d8-8146-7f9d58a1bf76', 'volume_name': 'volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebbc73f-1e77-4251-a784-7e42799962bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ebbc73f-1e77-4251-a784-7e42799962bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77eaba8f-469b-4ddf-a617-60fa1807fdc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Volume 8b03588d-b9d8-49d8-8146-7f9d58a1bf76: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76', 'volume_size': 1} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:28 devstack sudo[95261]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d" returned: 0 in 0.848s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:29 devstack sudo[95272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d Jul 06 21:13:29 devstack sudo[95272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:29 devstack sudo[95272]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d" returned: 0 in 0.811s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Lock "cinder-quobyte-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d" released by "delete_volume" :: held 1.732s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:29 devstack cinder-volume[87273]: DEBUG cinder.quota [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Created reservations ['059d086e-2035-4e85-bd83-bdfad9d1da95', 'a9e74422-015c-418c-9d14-45aeade5b81a', '0d3565c0-ae93-472a-8f92-f4321d3e08c5', '2f597444-5164-4316-b15b-eb930c5a87c9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:30 devstack sudo[95285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:13:30 devstack sudo[95285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:31 devstack sudo[95285]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.001s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:31 devstack cinder-volume[87273]: DEBUG cinder.manager [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Deleted volume successfully. Jul 06 21:13:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-663a2a4b-9b60-4e36-86d4-f0a48ca3739e req-df817ec5-450f-46e0-9cee-c4b2abca2593 tempest-VolumesGetTestJSON-770886402 None] Lock "cinder-9add9b71-59e1-4e3c-aab1-2a0eb1c4c95d-delete_volume" released by "delete_volume" :: held 3.177s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:34 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785" returned: 0 in 5.510s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:34 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2daadb64-76e8-4277-b204-c1e69a9b8a9e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:34 devstack sudo[95289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 Jul 06 21:13:34 devstack sudo[95289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:35 devstack sudo[95289]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046" returned: 0 in 0.940s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046, size 1024.00 MB, duration 5.51 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:13:35 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Converted 1024.00 MB image at 185.80 MB/s Jul 06 21:13:35 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 is being set with open permissions: ugo+rw Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:35 devstack sudo[95294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 Jul 06 21:13:35 devstack sudo[95294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:35 devstack sudo[95294]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-af737251-0d11-451d-88d7-c4611a4d7785" released by "_copy_volume_from_snapshot" :: held 8.788s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-90c89972-584c-4412-aa91-ca2c40cba977-af737251-0d11-451d-88d7-c4611a4d7785" released by "_create_volume_from_snapshot" :: held 8.823s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.852s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.926s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-144469440',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b03588d-b9d8-49d8-8146-7f9d58a1bf76,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27100f871ea48bf9be7b8e276f68309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:29Z,use_quota=True,user_id='2736151ce4c24fa487024b2b3a7b0e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Creating volume 8b03588d-b9d8-49d8-8146-7f9d58a1bf76 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:35 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:35 devstack sudo[95297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 1073741824 Jul 06 21:13:35 devstack sudo[95297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc83946-1e33-4d3c-8cc6-218290ca0236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af737251-0d11-451d-88d7-c4611a4d7785', 'volume_size': 1, 'snapshot_id': '90c89972-584c-4412-aa91-ca2c40cba977'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2946fa-1852-4c41-8c7d-fb5fcb5319b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Volume volume-af737251-0d11-451d-88d7-c4611a4d7785 (af737251-0d11-451d-88d7-c4611a4d7785): created successfully Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e2946fa-1852-4c41-8c7d-fb5fcb5319b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Flow 'volume_create_manager' (17869625-4c5c-4e24-9586-53db047cb255) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f8f30ac4-fb8b-4c55-b781-9817d47bec20 tempest-SnapshotDependencyTests-871721768 None] Created volume successfully. Jul 06 21:13:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ae5b788a-db57-4d89-97de-29ef39d903b9 tempest-GroupSnapshotsV319Test-656207842 None] Group tempest-GroupSnapshotsV319Test-Group-53040438: creating Jul 06 21:13:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ae5b788a-db57-4d89-97de-29ef39d903b9 tempest-GroupSnapshotsV319Test-656207842 None] Group tempest-GroupSnapshotsV319Test-Group-53040438: created successfully Jul 06 21:13:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ae5b788a-db57-4d89-97de-29ef39d903b9 tempest-GroupSnapshotsV319Test-656207842 None] Create group completed successfully. Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-90c89972-584c-4412-aa91-ca2c40cba977-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:36 devstack sudo[95297]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 1073741824" returned: 0 in 0.886s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-90c89972-584c-4412-aa91-ca2c40cba977-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-quobyte-694586be-3fa0-40d0-aa1f-e69af432f046" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-694586be-3fa0-40d0-aa1f-e69af432f046" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-quobyte-90c89972-584c-4412-aa91-ca2c40cba977" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-90c89972-584c-4412-aa91-ca2c40cba977" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Deleting offline snapshot 90c89972-584c-4412-aa91-ca2c40cba977 of volume 694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:13:36 devstack sudo[95303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 Jul 06 21:13:36 devstack sudo[95303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] snapshot_file for this snap is: volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b2d782a-47e0-42f5-83db-d8f297a326fa]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:36 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 Jul 06 21:13:36 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:37 devstack sudo[95303]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76" returned: 0 in 0.664s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] <== create_volume: return (1607ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.609s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77eaba8f-469b-4ddf-a617-60fa1807fdc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8928ea-eb86-46f3-8398-aa9502a91a36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:37 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Volume volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 (8b03588d-b9d8-49d8-8146-7f9d58a1bf76): created successfully Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f8928ea-eb86-46f3-8398-aa9502a91a36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Flow 'volume_create_manager' (aaacc642-97e5-4043-b8ca-4b531803492a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:37 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-91d5a1e7-412e-415a-955d-b3891ed1c184 tempest-AttachVolumeTestJSON-697008879 None] Created volume successfully. Jul 06 21:13:37 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977" returned: 0 in 0.808s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-694586be-3fa0-40d0-aa1f-e69af432f046(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfef4f45-8651-4d4b-9f89-600540941d9b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:37 devstack sudo[95312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 Jul 06 21:13:37 devstack sudo[95312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Flow 'volume_create_manager' (42422dbe-22fd-4ada-b07b-d9cd0de4a0c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab05d926-5cea-4807-9f6f-7df40024ce73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab05d926-5cea-4807-9f6f-7df40024ce73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1322325258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f4cfc34-407b-4085-bdf8-9554d6915eb1,host='devstack@QuobyteHD#QuobyteHD',id=ba904676-7daf-4e23-a3f1-d963283b8b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d305cac0f154ba38a94d35edc2b0321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:38Z,use_quota=True,user_id='deed92d5a5c64e6cb59bb2be4d247b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22d3bbe3-62c8-4c7f-8e87-a2f4c89860f7),volume_type_id=22d3bbe3-62c8-4c7f-8e87-a2f4c89860f7)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106eeaec-c55c-40a7-9cd7-b0ce44405d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (106eeaec-c55c-40a7-9cd7-b0ce44405d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4bdef5-6235-4e5b-9c7b-911cbe9a9679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da4bdef5-6235-4e5b-9c7b-911cbe9a9679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba904676-7daf-4e23-a3f1-d963283b8b7a', 'volume_name': 'volume-ba904676-7daf-4e23-a3f1-d963283b8b7a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90833cb-ce4f-41f4-b689-82b0c6c168d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b90833cb-ce4f-41f4-b689-82b0c6c168d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756a9c58-7cf3-4738-bd77-594e9ee66123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:38 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Volume ba904676-7daf-4e23-a3f1-d963283b8b7a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba904676-7daf-4e23-a3f1-d963283b8b7a', 'volume_size': 1} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=9f4cfc34-407b-4085-bdf8-9554d6915eb1,created_at=2026-07-06T19:13:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1322325258',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=9f4cfc34-407b-4085-bdf8-9554d6915eb1,host='devstack@QuobyteHD#QuobyteHD',id=ba904676-7daf-4e23-a3f1-d963283b8b7a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d305cac0f154ba38a94d35edc2b0321',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:38Z,use_quota=True,user_id='deed92d5a5c64e6cb59bb2be4d247b53',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(22d3bbe3-62c8-4c7f-8e87-a2f4c89860f7),volume_type_id=22d3bbe3-62c8-4c7f-8e87-a2f4c89860f7)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Creating volume ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:38 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:38 devstack sudo[95315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a 1073741824 Jul 06 21:13:38 devstack sudo[95315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:38 devstack sudo[95312]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046" returned: 0 in 0.765s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:38 devstack sudo[95320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 Jul 06 21:13:38 devstack sudo[95320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:39 devstack sudo[95315]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a 1073741824" returned: 0 in 0.884s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:39 devstack sudo[95332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a Jul 06 21:13:39 devstack sudo[95332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:39 devstack sudo[95320]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977" returned: 0 in 0.753s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:39 devstack sudo[95334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977 Jul 06 21:13:39 devstack sudo[95334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:39 devstack sudo[95332]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a" returned: 0 in 0.681s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] <== create_volume: return (1624ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.627s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (756a9c58-7cf3-4738-bd77-594e9ee66123) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba904676-7daf-4e23-a3f1-d963283b8b7a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203d5f32-e5fd-4c12-bad9-d86a42648e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:39 devstack sudo[95334]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046.90c89972-584c-4412-aa91-ca2c40cba977" returned: 0 in 0.685s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:39 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Volume volume-ba904676-7daf-4e23-a3f1-d963283b8b7a (ba904676-7daf-4e23-a3f1-d963283b8b7a): created successfully Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (203d5f32-e5fd-4c12-bad9-d86a42648e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Flow 'volume_create_manager' (42422dbe-22fd-4ada-b07b-d9cd0de4a0c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-90c89972-584c-4412-aa91-ca2c40cba977" released by "_delete_snapshot" :: held 3.139s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-21e02450-ce34-4b24-bda0-fff08114e7f1 tempest-GroupSnapshotsV319Test-656207842 None] Created volume successfully. Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-694586be-3fa0-40d0-aa1f-e69af432f046" released by "delete_snapshot" :: held 3.176s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:39 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Created reservations ['e0ad8e4a-de23-4cef-b107-0c34859dd141', 'b530c261-97fd-43ae-9f86-646e7998fc14', 'bdb2b73f-66eb-4dcf-ba0f-5c37985c129b', '9c4af9c0-dd61-4b09-af98-fb02e9810db4'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:40 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Delete snapshot completed successfully. Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ae40e8dc-3bfa-4b89-a491-e831cd434a97 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-90c89972-584c-4412-aa91-ca2c40cba977-delete_snapshot" released by "delete_snapshot" :: held 3.314s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:40 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] GroupSnapshot a928dd89-d480-40a2-9bd0-8cbbefa78d38: creating. Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Group snapshot a928dd89-d480-40a2-9bd0-8cbbefa78d38: creating. {{(pid=87273) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Creating offline snapshot e8ed1072-b682-4ee9-ab58-88d8c10efc7c of volume ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5330665a-3f63-40b1-bc0d-864648368c18]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:40 devstack sudo[95343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a Jul 06 21:13:40 devstack sudo[95343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-694586be-3fa0-40d0-aa1f-e69af432f046-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-694586be-3fa0-40d0-aa1f-e69af432f046-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-quobyte-694586be-3fa0-40d0-aa1f-e69af432f046" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-694586be-3fa0-40d0-aa1f-e69af432f046" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[90be67f2-1dc9-4d7e-b21c-250d9e698a97]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:41 devstack sudo[95354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 Jul 06 21:13:41 devstack sudo[95354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:41 devstack sudo[95343]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a" returned: 0 in 0.890s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:41 devstack sudo[95370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c 1G Jul 06 21:13:41 devstack sudo[95370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-9d0e7b0c-cb4c-4285-8a77-57760289710b req-1261d9ac-8411-4c8b-9c99-9d3f807c869b tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:41 devstack sudo[95354]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:41 devstack sudo[95376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046 Jul 06 21:13:41 devstack sudo[95376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:42 devstack sudo[95376]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-694586be-3fa0-40d0-aa1f-e69af432f046" returned: 0 in 0.660s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:42 devstack sudo[95370]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-694586be-3fa0-40d0-aa1f-e69af432f046" released by "delete_volume" :: held 1.516s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c 1G" returned: 0 in 0.927s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba904676-7daf-4e23-a3f1-d963283b8b7a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:42 devstack sudo[95382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba904676-7daf-4e23-a3f1-d963283b8b7a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c Jul 06 21:13:42 devstack sudo[95382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Created reservations ['546ed91e-a862-4e61-b295-b7f14855194f', '3b5f405d-2db1-4e49-9661-f712ecafaf01', '44c19835-70aa-4f0f-a77b-a5c42e7eea1f', '70a226a8-c6e5-45ae-8590-5157ab42027f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:42 devstack sudo[95384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:13:42 devstack sudo[95384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-af737251-0d11-451d-88d7-c4611a4d7785-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-af737251-0d11-451d-88d7-c4611a4d7785-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "cinder-quobyte-af737251-0d11-451d-88d7-c4611a4d7785" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-af737251-0d11-451d-88d7-c4611a4d7785" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07513ef-7ba0-4747-b31f-8dd2f67ba3b9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:43 devstack sudo[95382]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba904676-7daf-4e23-a3f1-d963283b8b7a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c" returned: 0 in 0.813s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:43 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:43 devstack sudo[95384]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.692s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:43 devstack sudo[95391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c Jul 06 21:13:43 devstack sudo[95391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Deleted volume successfully. Jul 06 21:13:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4900e584-91d7-466d-af25-8801556d8161 tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-694586be-3fa0-40d0-aa1f-e69af432f046-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:43 devstack sudo[95390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 Jul 06 21:13:43 devstack sudo[95390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:44 devstack sudo[95391]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c" returned: 0 in 0.669s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:44 devstack sudo[95398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.info Jul 06 21:13:44 devstack sudo[95398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:44 devstack sudo[95390]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785" returned: 0 in 0.797s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:44 devstack sudo[95400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785 Jul 06 21:13:44 devstack sudo[95400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:44 devstack sudo[95398]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.info" returned: 0 in 0.658s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:44 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.info is being set with open permissions: ugo+rw: NotImplementedError Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:44 devstack sudo[95440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.info Jul 06 21:13:44 devstack sudo[95440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:44 devstack sudo[95400]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-af737251-0d11-451d-88d7-c4611a4d7785" returned: 0 in 0.685s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-quobyte-af737251-0d11-451d-88d7-c4611a4d7785" released by "delete_volume" :: held 1.549s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Created reservations ['d6526957-7f06-427c-9aaa-77b93e573626', 'bdd35682-234b-40ed-8977-3e5c3b4079ac', '8c522e78-71b2-458e-9a19-5090e7c23239', 'e6a144c2-6426-42aa-b031-dd583ed113b5'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:45 devstack sudo[95442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:13:45 devstack sudo[95442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:45 devstack sudo[95440]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.info" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.737s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-9d0e7b0c-cb4c-4285-8a77-57760289710b req-1261d9ac-8411-4c8b-9c99-9d3f807c869b tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 3.712s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f2f257-ee36-4b9a-907c-f041a7254cd4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-9d0e7b0c-cb4c-4285-8a77-57760289710b req-1261d9ac-8411-4c8b-9c99-9d3f807c869b tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-06767ad5-3dd3-4367-aa90-539ef7909aeb tempest-GroupSnapshotsV319Test-656207842 None] group_snapshot a928dd89-d480-40a2-9bd0-8cbbefa78d38: created successfully Jul 06 21:13:45 devstack sudo[95445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 Jul 06 21:13:45 devstack sudo[95445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:45 devstack sudo[95442]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.725s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Deleted volume successfully. Jul 06 21:13:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44794adc-048c-4ba6-9572-297296481bbf tempest-SnapshotDependencyTests-871721768 None] Lock "cinder-af737251-0d11-451d-88d7-c4611a4d7785-delete_volume" released by "delete_volume" :: held 2.497s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] group_snapshot a928dd89-d480-40a2-9bd0-8cbbefa78d38: deleting Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:INSERT=19,cinder:UPDATE=90,cinder:SELECT=68,cinder:DELETE=9 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:13:46 devstack sudo[95445]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] group_snapshot a928dd89-d480-40a2-9bd0-8cbbefa78d38: deleting {{(pid=87273) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-9d0e7b0c-cb4c-4285-8a77-57760289710b req-1261d9ac-8411-4c8b-9c99-9d3f807c869b tempest-AttachVolumeTestJSON-697008879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76" returned: 0 in 0.887s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-9d0e7b0c-cb4c-4285-8a77-57760289710b req-1261d9ac-8411-4c8b-9c99-9d3f807c869b tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.924s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Acquiring lock "cinder-quobyte-ba904676-7daf-4e23-a3f1-d963283b8b7a" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Lock "cinder-quobyte-ba904676-7daf-4e23-a3f1-d963283b8b7a" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Acquiring lock "cinder-quobyte-e8ed1072-b682-4ee9-ab58-88d8c10efc7c" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Lock "cinder-quobyte-e8ed1072-b682-4ee9-ab58-88d8c10efc7c" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Deleting offline snapshot e8ed1072-b682-4ee9-ab58-88d8c10efc7c of volume ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] snapshot_file for this snap is: volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-9d0e7b0c-cb4c-4285-8a77-57760289710b req-1261d9ac-8411-4c8b-9c99-9d3f807c869b tempest-AttachVolumeTestJSON-697008879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'baa314d0-bba0-47c6-adbd-02240a58ebdf', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f1ea344-3649-457b-a6df-52bbe6484239]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-9d0e7b0c-cb4c-4285-8a77-57760289710b req-1261d9ac-8411-4c8b-9c99-9d3f807c869b tempest-AttachVolumeTestJSON-697008879 None] attachment_update completed successfully. Jul 06 21:13:46 devstack sudo[95451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c Jul 06 21:13:46 devstack sudo[95451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:47 devstack sudo[95451]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c" returned: 0 in 0.977s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba904676-7daf-4e23-a3f1-d963283b8b7a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:13:47 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa4a24f-b8d3-4a3e-b47d-a27af488ee95]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:47 devstack sudo[95712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a Jul 06 21:13:47 devstack sudo[95712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:48 devstack sudo[95712]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a" returned: 0 in 0.866s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:48 devstack sudo[95845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c Jul 06 21:13:48 devstack sudo[95845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:49 devstack sudo[95845]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c" returned: 0 in 0.882s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:49 devstack sudo[95851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c Jul 06 21:13:49 devstack sudo[95851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:50 devstack sudo[95851]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a.e8ed1072-b682-4ee9-ab58-88d8c10efc7c" returned: 0 in 0.730s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Lock "cinder-quobyte-e8ed1072-b682-4ee9-ab58-88d8c10efc7c" released by "_delete_snapshot" :: held 3.584s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Lock "cinder-quobyte-ba904676-7daf-4e23-a3f1-d963283b8b7a" released by "delete_snapshot" :: held 3.616s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:50 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=69,cinder:INSERT=20,cinder:UPDATE=67,cinder:DELETE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:13:50 devstack cinder-volume[87273]: WARNING cinder.quota [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1700217920 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1700217920, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:13:50 devstack cinder-volume[87273]: WARNING cinder.quota [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1700217920 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1700217920, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:13:50 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] Created reservations ['4fd336f4-7c0f-44a8-8f7f-dd605c40d8cd', '05867a6d-36da-4841-ac1c-35e9bf2b7fed', '9442ff3c-a6a6-4cc0-86a9-2b7803e5fd3a', '3067585e-2f64-4c0e-a16c-ceb880c46fee'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8f172fe7-bd98-413c-be6f-635f0a008efe tempest-GroupSnapshotsV319Test-656207842 None] group_snapshot a928dd89-d480-40a2-9bd0-8cbbefa78d38: deleted successfully Jul 06 21:13:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Acquiring lock "cinder-quobyte-ba904676-7daf-4e23-a3f1-d963283b8b7a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:13:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Lock "cinder-quobyte-ba904676-7daf-4e23-a3f1-d963283b8b7a" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:13:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[305e750a-22ac-4140-915f-3a0255405bed]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:51 devstack sudo[95856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a Jul 06 21:13:51 devstack sudo[95856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:51 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Flow 'volume_create_manager' (41199390-40ba-4af6-9c61-25b3c6a1780e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be83c8e4-4a05-4c76-8ecc-8529a89a97ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (be83c8e4-4a05-4c76-8ecc-8529a89a97ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-804850539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e4bc0e-06fc-4b47-a719-dd9ee5a54272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27100f871ea48bf9be7b8e276f68309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:52Z,use_quota=True,user_id='2736151ce4c24fa487024b2b3a7b0e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60be274e-f0f5-49c8-94e7-a0fd53a12654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60be274e-f0f5-49c8-94e7-a0fd53a12654) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e1615-879b-4b30-9348-ddeb97485c82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (481e1615-879b-4b30-9348-ddeb97485c82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e4bc0e-06fc-4b47-a719-dd9ee5a54272', 'volume_name': 'volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7473a435-d08d-4dee-b6f1-bef4e94723fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7473a435-d08d-4dee-b6f1-bef4e94723fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f08d9d-3658-4382-b21f-d6151a22dafc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:52 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Volume 01e4bc0e-06fc-4b47-a719-dd9ee5a54272: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272', 'volume_size': 1} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:13:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-804850539',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e4bc0e-06fc-4b47-a719-dd9ee5a54272,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b27100f871ea48bf9be7b8e276f68309',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:13:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:13:52Z,use_quota=True,user_id='2736151ce4c24fa487024b2b3a7b0e98',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Creating volume 01e4bc0e-06fc-4b47-a719-dd9ee5a54272 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:13:52 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:52 devstack sudo[95862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 1073741824 Jul 06 21:13:52 devstack sudo[95862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:52 devstack sudo[95856]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a" returned: 0 in 0.910s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:52 devstack sudo[95864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a Jul 06 21:13:52 devstack sudo[95864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:53 devstack sudo[95864]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ba904676-7daf-4e23-a3f1-d963283b8b7a" returned: 0 in 0.854s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:53 devstack sudo[95862]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 1073741824" returned: 0 in 0.998s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Lock "cinder-quobyte-ba904676-7daf-4e23-a3f1-d963283b8b7a" released by "delete_volume" :: held 1.862s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:53 devstack sudo[95871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 Jul 06 21:13:53 devstack sudo[95871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Created reservations ['b78c2a85-14b9-4149-a27f-764e94d7bc7d'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:53 devstack cinder-volume[87273]: WARNING cinder.quota [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1700217920 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1700217920, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Created reservations ['ce42a66f-a290-4f63-934c-77dd171fd546', 'dc375619-07f2-45be-ade2-953ada40aa7a', '06db4ae9-4103-43f0-bf54-5c83a6e9dfbc', 'd463f9aa-8606-45b3-b90b-0a4f233b2ee0'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:53 devstack sudo[95874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:13:53 devstack sudo[95874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:53 devstack sudo[95871]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272" returned: 0 in 0.817s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:13:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6f08d9d-3658-4382-b21f-d6151a22dafc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915445d1-3b2f-4e5f-8d96-f8344b55addb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:13:54 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Volume volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 (01e4bc0e-06fc-4b47-a719-dd9ee5a54272): created successfully Jul 06 21:13:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (915445d1-3b2f-4e5f-8d96-f8344b55addb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:13:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Flow 'volume_create_manager' (41199390-40ba-4af6-9c61-25b3c6a1780e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:13:54 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d0175b87-bd9c-45f8-bb62-df6b186831b5 tempest-AttachVolumeTestJSON-697008879 None] Created volume successfully. Jul 06 21:13:54 devstack sudo[95874]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.711s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:54 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:13:54 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3a0d1963-b8df-4b1e-8932-cd6b5938f31d tempest-GroupSnapshotsV319Test-656207842 None] Delete group completed successfully. Jul 06 21:13:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-30d949e9-c66a-42c1-ae44-2ff9a5dda7d2 req-804a6335-e7b1-4769-ab72-a53ca2602703 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:13:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-30d949e9-c66a-42c1-ae44-2ff9a5dda7d2 req-804a6335-e7b1-4769-ab72-a53ca2602703 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:13:58 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[aec9c974-69c0-4759-b2c5-bce6ad556660]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:13:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-30d949e9-c66a-42c1-ae44-2ff9a5dda7d2 req-804a6335-e7b1-4769-ab72-a53ca2602703 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:13:58 devstack sudo[95900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 Jul 06 21:13:58 devstack sudo[95900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:13:59 devstack sudo[95900]: pam_unix(sudo:session): session closed for user root Jul 06 21:13:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-30d949e9-c66a-42c1-ae44-2ff9a5dda7d2 req-804a6335-e7b1-4769-ab72-a53ca2602703 tempest-AttachVolumeTestJSON-697008879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272" returned: 0 in 0.769s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:13:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-30d949e9-c66a-42c1-ae44-2ff9a5dda7d2 req-804a6335-e7b1-4769-ab72-a53ca2602703 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.789s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:13:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-30d949e9-c66a-42c1-ae44-2ff9a5dda7d2 req-804a6335-e7b1-4769-ab72-a53ca2602703 tempest-AttachVolumeTestJSON-697008879 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0cd72dc0-8422-4602-9f17-88b442670042', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:13:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-30d949e9-c66a-42c1-ae44-2ff9a5dda7d2 req-804a6335-e7b1-4769-ab72-a53ca2602703 tempest-AttachVolumeTestJSON-697008879 None] attachment_update completed successfully. Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:01 devstack sudo[95910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:14:01 devstack sudo[95910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:01 devstack sudo[95910]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:14:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:14:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-42753675-67bd-4504-8a98-9a38ddff8474 req-f1c328ed-8ce2-4b5e-aae3-c0ccb7368cb1 tempest-AttachVolumeTestJSON-697008879 None] Terminate volume connection completed successfully. Jul 06 21:14:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-42753675-67bd-4504-8a98-9a38ddff8474 req-f1c328ed-8ce2-4b5e-aae3-c0ccb7368cb1 tempest-AttachVolumeTestJSON-697008879 None] Deleting attachment baa314d0-bba0-47c6-adbd-02240a58ebdf. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:14:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-57278b76-71d9-4e41-89c8-96969dcc4523 req-96db6e3e-d03f-4b82-bc15-b716b024577a tempest-AttachVolumeTestJSON-697008879 None] Terminate volume connection completed successfully. Jul 06 21:14:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-57278b76-71d9-4e41-89c8-96969dcc4523 req-96db6e3e-d03f-4b82-bc15-b716b024577a tempest-AttachVolumeTestJSON-697008879 None] Deleting attachment 0cd72dc0-8422-4602-9f17-88b442670042. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:14:18 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=36,cinder:UPDATE=21,cinder:INSERT=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:14:18 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=15,cinder:INSERT=8,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:14:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "cinder-01e4bc0e-06fc-4b47-a719-dd9ee5a54272-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-01e4bc0e-06fc-4b47-a719-dd9ee5a54272-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "cinder-quobyte-01e4bc0e-06fc-4b47-a719-dd9ee5a54272" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-quobyte-01e4bc0e-06fc-4b47-a719-dd9ee5a54272" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:19 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce6b1f41-1ad6-4eb3-96a1-2258beaa6122]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:19 devstack sudo[95973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 Jul 06 21:14:19 devstack sudo[95973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:20 devstack sudo[95973]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272" returned: 0 in 0.870s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:20 devstack sudo[95978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272 Jul 06 21:14:20 devstack sudo[95978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:21 devstack sudo[95978]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-01e4bc0e-06fc-4b47-a719-dd9ee5a54272" returned: 0 in 0.687s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-quobyte-01e4bc0e-06fc-4b47-a719-dd9ee5a54272" released by "delete_volume" :: held 1.601s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Created reservations ['6844d0f8-83b6-4e7b-9bcd-1b38b996b928', 'c335c07a-2a45-48cc-bd12-5dad206881e5', 'baf738b7-b6af-4398-b3bc-67f3cc67914e', '33f3b456-1f16-4c4d-9ede-31fdc50ecda0'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:21 devstack sudo[95981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:14:21 devstack sudo[95981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "cinder-8b03588d-b9d8-49d8-8146-7f9d58a1bf76-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-8b03588d-b9d8-49d8-8146-7f9d58a1bf76-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "cinder-quobyte-8b03588d-b9d8-49d8-8146-7f9d58a1bf76" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-quobyte-8b03588d-b9d8-49d8-8146-7f9d58a1bf76" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f7f4856-7cd6-434a-afdc-4f8d18dfebcf]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:22 devstack sudo[95981]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.700s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:22 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Deleted volume successfully. Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3bdcd1dc-5c27-43c1-a3c9-40d1f4dcb8d9 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-01e4bc0e-06fc-4b47-a719-dd9ee5a54272-delete_volume" released by "delete_volume" :: held 2.538s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:22 devstack sudo[95984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 Jul 06 21:14:22 devstack sudo[95984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:22 devstack sudo[95984]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76" returned: 0 in 0.871s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:23 devstack sudo[95989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76 Jul 06 21:14:23 devstack sudo[95989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:23 devstack sudo[95989]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8b03588d-b9d8-49d8-8146-7f9d58a1bf76" returned: 0 in 0.700s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-quobyte-8b03588d-b9d8-49d8-8146-7f9d58a1bf76" released by "delete_volume" :: held 1.619s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Created reservations ['bfe93388-1fd1-4bd6-b1e0-837d5d652fdc', 'ad969817-ef34-4ebf-aa9f-81052c2f6cd7', '8c349a75-d804-4259-9ff5-ad8139374c6b', '87f9b32d-a5d2-4690-921f-76f9c4f74fa6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:23 devstack sudo[95995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:14:23 devstack sudo[95995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "cinder-b662c6bc-48d0-44f9-9ced-62ff92b6e336-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-b662c6bc-48d0-44f9-9ced-62ff92b6e336-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "cinder-quobyte-b662c6bc-48d0-44f9-9ced-62ff92b6e336" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-quobyte-b662c6bc-48d0-44f9-9ced-62ff92b6e336" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[eca13c37-e471-4a65-a4e3-686553233edc]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:24 devstack sudo[95995]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.759s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:24 devstack sudo[95999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 Jul 06 21:14:24 devstack sudo[95999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Deleted volume successfully. Jul 06 21:14:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eacafd29-9067-4816-b8f6-cccf35802bca tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-8b03588d-b9d8-49d8-8146-7f9d58a1bf76-delete_volume" released by "delete_volume" :: held 2.666s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:25 devstack sudo[95999]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336" returned: 0 in 0.842s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:25 devstack sudo[96005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336 Jul 06 21:14:25 devstack sudo[96005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:25 devstack sudo[96005]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b662c6bc-48d0-44f9-9ced-62ff92b6e336" returned: 0 in 0.626s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-quobyte-b662c6bc-48d0-44f9-9ced-62ff92b6e336" released by "delete_volume" :: held 1.513s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Created reservations ['6cb63273-b982-45d1-a072-06c1a368b005', 'b044ab1a-c8bf-4247-93fb-e5893749544b', 'e6446c1e-8624-4593-a698-86e5ed73f952', '6f3cf049-78e2-4906-9ef0-743ad98af4f4'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:26 devstack sudo[96008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:14:26 devstack sudo[96008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:26 devstack sudo[96008]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.635s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Deleted volume successfully. Jul 06 21:14:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7efa0227-0713-423e-8449-8c81af4eb479 tempest-AttachVolumeTestJSON-697008879 None] Lock "cinder-b662c6bc-48d0-44f9-9ced-62ff92b6e336-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:36 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=17,cinder:INSERT=9,cinder:UPDATE=21,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:14:36 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=27,cinder:SELECT=13,cinder:INSERT=3,cinder:DELETE=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (583bd43a-c31e-4a7a-99b6-8b08087e1128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0fc95e-0ff2-444d-b26d-ba23c22e0579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a0fc95e-0ff2-444d-b26d-ba23c22e0579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206867414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:40Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac79489-7897-4469-a978-999b94bf2d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fac79489-7897-4469-a978-999b94bf2d52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a95ae8e-6416-423e-b4e1-3f3754b4aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a95ae8e-6416-423e-b4e1-3f3754b4aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a9f1e6-68a0-4d1d-8ad9-d01e44535c24', 'volume_name': 'volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0a84af-fb0c-43e2-a609-7d066b8205b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd0a84af-fb0c-43e2-a609-7d066b8205b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d528dd-dc8f-4e49-91d7-4370241852a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:40 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Volume d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24', 'volume_size': 1} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1206867414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:40Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Creating volume d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:40 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:14:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:40 devstack sudo[96100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 1073741824 Jul 06 21:14:40 devstack sudo[96100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:41 devstack sudo[96100]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 1073741824" returned: 0 in 1.104s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:41 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 Jul 06 21:14:41 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:41 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" returned: 0 in 0.795s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] <== create_volume: return (1946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.949s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6d528dd-dc8f-4e49-91d7-4370241852a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a044923-1a3f-40ee-a90b-e69a6db0b00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:42 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Volume volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 (d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24): created successfully Jul 06 21:14:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a044923-1a3f-40ee-a90b-e69a6db0b00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (583bd43a-c31e-4a7a-99b6-8b08087e1128) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1bac0018-3287-4a19-8f8f-1918a5ce173c tempest-VolumesActionsTest-1349342923 None] Created volume successfully. Jul 06 21:14:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8580e463-961f-4420-ab61-147f03345257 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" by "attach_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8580e463-961f-4420-ab61-147f03345257 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" acquired by "attach_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8580e463-961f-4420-ab61-147f03345257 tempest-VolumesActionsTest-1349342923 None] Attaching volume d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 to instance c61b684f-bceb-47b5-8ef7-771bc4466be4 at mountpoint /dev/vdb on host None. Jul 06 21:14:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8580e463-961f-4420-ab61-147f03345257 tempest-VolumesActionsTest-1349342923 None] Attach volume completed successfully. Jul 06 21:14:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-8580e463-961f-4420-ab61-147f03345257 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" released by "attach_volume" :: held 0.121s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c1975d59-3eaa-40d5-bfe6-f683ffd61813 tempest-VolumesActionsTest-435685269 None] Terminate volume connection completed successfully. Jul 06 21:14:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c1975d59-3eaa-40d5-bfe6-f683ffd61813 tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-detach_volume" by "detach_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c1975d59-3eaa-40d5-bfe6-f683ffd61813 tempest-VolumesActionsTest-435685269 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-detach_volume" acquired by "detach_volume" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c1975d59-3eaa-40d5-bfe6-f683ffd61813 tempest-VolumesActionsTest-435685269 None] Detaching volume d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 from instance c61b684f-bceb-47b5-8ef7-771bc4466be4. Jul 06 21:14:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c1975d59-3eaa-40d5-bfe6-f683ffd61813 tempest-VolumesActionsTest-435685269 None] Detach volume completed successfully. Jul 06 21:14:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c1975d59-3eaa-40d5-bfe6-f683ffd61813 tempest-VolumesActionsTest-435685269 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-detach_volume" released by "detach_volume" :: held 0.115s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-70739fec-635d-4a76-a668-076115fd0c64 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-detach_volume" by "detach_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-70739fec-635d-4a76-a668-076115fd0c64 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-detach_volume" acquired by "detach_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-70739fec-635d-4a76-a668-076115fd0c64 tempest-VolumesActionsTest-1349342923 None] Volume detach called, but volume not attached. Jul 06 21:14:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-70739fec-635d-4a76-a668-076115fd0c64 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-detach_volume" released by "detach_volume" :: held 0.042s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "cinder-quobyte-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-quobyte-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:46 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[566f6196-f521-44a6-8a8a-9b8c4e6b707d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:46 devstack sudo[96162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 Jul 06 21:14:46 devstack sudo[96162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:47 devstack sudo[96162]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" returned: 0 in 0.819s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:47 devstack sudo[96167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24 Jul 06 21:14:47 devstack sudo[96167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:48 devstack sudo[96167]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" returned: 0 in 0.840s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-quobyte-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24" released by "delete_volume" :: held 1.723s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Created reservations ['fc8fb013-3c96-4b3a-bd54-2f10ceb7515b', '6695f8c8-1541-4fec-9d9e-07e255efffb8', 'be74b795-dd2b-48fd-a6d9-47ccb406c17f', '08c29773-4523-48f9-bf34-17ad9ae77132'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:48 devstack sudo[96171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:14:48 devstack sudo[96171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:49 devstack sudo[96171]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:49 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:14:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Deleted volume successfully. Jul 06 21:14:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fc4a0f6f-f9c5-4dd6-8ddf-c09c61a50fc7 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-d5a9f1e6-68a0-4d1d-8ad9-d01e44535c24-delete_volume" released by "delete_volume" :: held 2.781s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:14:56 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:14:56 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (1ba8bcac-52d1-4f3c-8f2f-13e7938aa381) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:56 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0e5f07-da85-4620-9273-21674641e54b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:56 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f0e5f07-da85-4620-9273-21674641e54b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-182698477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4a6fb4-10d4-448a-b868-646fde42543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:57Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:56 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303a7dfc-79ca-408f-965d-9837cf514c33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:56 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303a7dfc-79ca-408f-965d-9837cf514c33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdeca8ba-28c5-4c4e-afbb-9579dc1cc444) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bdeca8ba-28c5-4c4e-afbb-9579dc1cc444) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f4a6fb4-10d4-448a-b868-646fde42543a', 'volume_name': 'volume-8f4a6fb4-10d4-448a-b868-646fde42543a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31013be2-de7e-4102-a12f-877b8cd01a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31013be2-de7e-4102-a12f-877b8cd01a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26996d23-ae08-4ae4-8b82-4cd2c98f7cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Volume 8f4a6fb4-10d4-448a-b868-646fde42543a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f4a6fb4-10d4-448a-b868-646fde42543a', 'volume_size': 1} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:14:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-182698477',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f4a6fb4-10d4-448a-b868-646fde42543a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:14:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:14:57Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Creating volume 8f4a6fb4-10d4-448a-b868-646fde42543a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:14:57 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:14:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:57 devstack sudo[96242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a 1073741824 Jul 06 21:14:57 devstack sudo[96242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:57 devstack sudo[96242]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a 1073741824" returned: 0 in 0.966s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:58 devstack sudo[96248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a Jul 06 21:14:58 devstack sudo[96248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:14:58 devstack sudo[96248]: pam_unix(sudo:session): session closed for user root Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] <== create_volume: return (1662ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.665s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26996d23-ae08-4ae4-8b82-4cd2c98f7cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f4a6fb4-10d4-448a-b868-646fde42543a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628c4e37-dc5b-434b-be83-320b44815ee7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:14:58 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Volume volume-8f4a6fb4-10d4-448a-b868-646fde42543a (8f4a6fb4-10d4-448a-b868-646fde42543a): created successfully Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (628c4e37-dc5b-434b-be83-320b44815ee7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:14:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (1ba8bcac-52d1-4f3c-8f2f-13e7938aa381) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:14:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-524942ce-3cf0-4170-8479-ed3b76d475ca tempest-VolumesActionsTest-1349342923 None] Created volume successfully. Jul 06 21:14:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-8f4a6fb4-10d4-448a-b868-646fde42543a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Lock "cinder-8f4a6fb4-10d4-448a-b868-646fde42543a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-quobyte-8f4a6fb4-10d4-448a-b868-646fde42543a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:14:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-8f4a6fb4-10d4-448a-b868-646fde42543a" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:14:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f76c826-0e93-4672-87f7-4ae40c5704c0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:14:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:14:59 devstack sudo[96286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a Jul 06 21:14:59 devstack sudo[96286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:00 devstack sudo[96286]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a" returned: 0 in 0.888s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:00 devstack sudo[96307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a Jul 06 21:15:00 devstack sudo[96307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:01 devstack sudo[96307]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f4a6fb4-10d4-448a-b868-646fde42543a" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-8f4a6fb4-10d4-448a-b868-646fde42543a" released by "delete_volume" :: held 1.600s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Created reservations ['174193f8-1e1f-4a93-969f-9f0207c322c9', '8b231e95-e0de-4703-b2d6-71d9f71836c0', '91d20669-7d4f-4c31-b998-102965e30fa5', '3f274ff6-e6f9-4d68-b696-ee835fed2112'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:01 devstack sudo[96330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:01 devstack sudo[96330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:01 devstack sudo[96332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:01 devstack sudo[96332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:01 devstack sudo[96330]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.734s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:15:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:15:02 devstack sudo[96332]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.875s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Deleted volume successfully. Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5405764-bc8e-4497-9c83-dc543cc54b8b tempest-VolumesActionsTest-435685269 None] Lock "cinder-8f4a6fb4-10d4-448a-b868-646fde42543a-delete_volume" released by "delete_volume" :: held 2.744s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (34c6669a-fa03-4e55-8671-e8751bc7c041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8a4cb6-33a9-4d03-9134-d51d2a01eaba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8a4cb6-33a9-4d03-9134-d51d2a01eaba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-604288431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5bf6e1-146a-40b7-afa4-13a459cfacf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:02Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd78e735-4dc4-4e6a-9da7-1a4f70238b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd78e735-4dc4-4e6a-9da7-1a4f70238b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497a87df-1c6b-4c71-952c-4181d348efdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (497a87df-1c6b-4c71-952c-4181d348efdd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5bf6e1-146a-40b7-afa4-13a459cfacf3', 'volume_name': 'volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0d9591-3cf8-4110-ba56-e60caafc2e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f0d9591-3cf8-4110-ba56-e60caafc2e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe153de-9740-430f-916b-d2dbcd11797b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Volume 0a5bf6e1-146a-40b7-afa4-13a459cfacf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3', 'volume_size': 1} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-604288431',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5bf6e1-146a-40b7-afa4-13a459cfacf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:02Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Creating volume 0a5bf6e1-146a-40b7-afa4-13a459cfacf3 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:02 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:02 devstack sudo[96341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 1073741824 Jul 06 21:15:02 devstack sudo[96341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:03 devstack sudo[96341]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 1073741824" returned: 0 in 0.956s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:03 devstack sudo[96347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 Jul 06 21:15:03 devstack sudo[96347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:03 devstack sudo[96347]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fbe153de-9740-430f-916b-d2dbcd11797b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5418697f-9dbb-45ef-92b2-8621b76e81fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Volume volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 (0a5bf6e1-146a-40b7-afa4-13a459cfacf3): created successfully Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5418697f-9dbb-45ef-92b2-8621b76e81fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (34c6669a-fa03-4e55-8671-e8751bc7c041) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:04 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-56f7311a-beac-407a-a7bc-bd44c65e094a tempest-VolumesActionsTest-1349342923 None] Created volume successfully. Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-0a5bf6e1-146a-40b7-afa4-13a459cfacf3-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Lock "cinder-0a5bf6e1-146a-40b7-afa4-13a459cfacf3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-quobyte-0a5bf6e1-146a-40b7-afa4-13a459cfacf3" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-0a5bf6e1-146a-40b7-afa4-13a459cfacf3" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f3e78af-3a82-41d1-910a-065ee53b7422]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:04 devstack sudo[96350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 Jul 06 21:15:04 devstack sudo[96350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:05 devstack sudo[96350]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3" returned: 0 in 0.850s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:05 devstack sudo[96357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3 Jul 06 21:15:05 devstack sudo[96357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:06 devstack sudo[96357]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0a5bf6e1-146a-40b7-afa4-13a459cfacf3" returned: 0 in 0.622s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-0a5bf6e1-146a-40b7-afa4-13a459cfacf3" released by "delete_volume" :: held 1.538s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Created reservations ['0b70562b-95b6-4d4d-a350-93e5ffb3dfb8', '62a6edef-3c89-4de3-a6e7-db1840338ddc', '7736d459-4a6d-46d5-9e03-16c628aa5f45', 'f183593f-0407-463d-b371-bbbd7d2a26bb'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:06 devstack sudo[96360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:06 devstack sudo[96360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:06 devstack sudo[96360]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Deleted volume successfully. Jul 06 21:15:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23834f92-6093-4f9f-a8a4-b499d1943494 tempest-VolumesActionsTest-435685269 None] Lock "cinder-0a5bf6e1-146a-40b7-afa4-13a459cfacf3-delete_volume" released by "delete_volume" :: held 2.462s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (fa274b96-a73a-4c3c-92bf-46e0616ee079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29bd315-1ba7-41b9-a608-fe591f0b343e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c29bd315-1ba7-41b9-a608-fe591f0b343e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267405847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:07Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31e6111-d7e8-4654-8ca8-e3b186fba72d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c31e6111-d7e8-4654-8ca8-e3b186fba72d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a49747-5683-48e4-92e4-9c601218cbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44a49747-5683-48e4-92e4-9c601218cbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b', 'volume_name': 'volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0615c70-a488-4678-9171-e019a81b1e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0615c70-a488-4678-9171-e019a81b1e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32070a9-24ad-4732-9b46-a367f39881ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Volume 9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b', 'volume_size': 1} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1267405847',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:07Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Creating volume 9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:07 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:07 devstack sudo[96363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b 1073741824 Jul 06 21:15:07 devstack sudo[96363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:08 devstack sudo[96363]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b 1073741824" returned: 0 in 0.838s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:08 devstack sudo[96368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b Jul 06 21:15:08 devstack sudo[96368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Acquiring lock "cinder-e3857164-1245-4803-b084-08fe1bccbf98-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "cinder-e3857164-1245-4803-b084-08fe1bccbf98-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Acquiring lock "cinder-quobyte-e3857164-1245-4803-b084-08fe1bccbf98" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "cinder-quobyte-e3857164-1245-4803-b084-08fe1bccbf98" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ab3c30b-43cd-46ac-91bf-4d2cc25159e7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:08 devstack sudo[96371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 Jul 06 21:15:08 devstack sudo[96371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:08 devstack sudo[96368]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b" returned: 0 in 0.651s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] <== create_volume: return (1542ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32070a9-24ad-4732-9b46-a367f39881ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9702f6-b3b2-49b2-aefa-4ff7e33d3cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:08 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Volume volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b (9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b): created successfully Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d9702f6-b3b2-49b2-aefa-4ff7e33d3cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (fa274b96-a73a-4c3c-92bf-46e0616ee079) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f0ec58a2-85af-4e31-b429-c75eacef3100 tempest-VolumesActionsTest-1349342923 None] Created volume successfully. Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:09 devstack sudo[96371]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Lock "cinder-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:09 devstack sudo[96377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98 Jul 06 21:15:09 devstack sudo[96377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-quobyte-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d800226-e3af-4189-8b66-9dfe1794fd58]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:09 devstack sudo[96379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b Jul 06 21:15:09 devstack sudo[96379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:10 devstack sudo[96377]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e3857164-1245-4803-b084-08fe1bccbf98" returned: 0 in 0.714s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "cinder-quobyte-e3857164-1245-4803-b084-08fe1bccbf98" released by "delete_volume" :: held 1.590s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Created reservations ['0a306627-33e9-4dd6-a7d1-8dda24121267', '00328b2f-6736-403e-ab30-4c946d9a4f5c', '941fef66-feaa-4fed-bbbb-a506b0d24b55', 'ba1b0a95-5c5b-4a14-8af9-f723afa93a7e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:10 devstack sudo[96385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:10 devstack sudo[96385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:10 devstack sudo[96379]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b" returned: 0 in 0.838s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:10 devstack sudo[96387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b Jul 06 21:15:10 devstack sudo[96387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:11 devstack sudo[96385]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.749s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:11 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Deleted volume successfully. Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e972d99c-db76-4cbc-a715-3854ab2ccd20 tempest-TestServerVolumeAttachScenarioOldVersion-1569797324 None] Lock "cinder-e3857164-1245-4803-b084-08fe1bccbf98-delete_volume" released by "delete_volume" :: held 2.611s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:11 devstack sudo[96387]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b" returned: 0 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b" released by "delete_volume" :: held 1.627s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Created reservations ['9569dd77-05e2-4f4c-ac87-cdd825455c95', '321794fa-2a07-451b-b5af-68cd767d5daf', '9abfd20f-41a0-4811-bb64-6aca4c8f0fdc', '258d0e67-50de-400c-9a97-a18a6403bb62'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:11 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:11 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:12 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.751s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Deleted volume successfully. Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-327a6f91-a5b2-40ac-a336-1a29450af427 tempest-VolumesActionsTest-435685269 None] Lock "cinder-9cc5d6ed-19b3-4a01-bd4f-8162bc10b59b-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (e92d4552-3eec-48b4-b556-059ff028d5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f0fd6-c246-45ac-8f5b-75a6c3d69239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (903f0fd6-c246-45ac-8f5b-75a6c3d69239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512311851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6347af88-8b05-4096-8099-11e86a2508f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:12Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477b6abc-f8c9-46b8-9914-7e12281d5979) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (477b6abc-f8c9-46b8-9914-7e12281d5979) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e51a81f-8061-44b9-88dd-79b68f528fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e51a81f-8061-44b9-88dd-79b68f528fb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6347af88-8b05-4096-8099-11e86a2508f7', 'volume_name': 'volume-6347af88-8b05-4096-8099-11e86a2508f7', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a012e005-72ed-4ceb-bc27-f0c759a850a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a012e005-72ed-4ceb-bc27-f0c759a850a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03272b74-9aa4-42c1-aaff-fbd5310f0bd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Volume 6347af88-8b05-4096-8099-11e86a2508f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6347af88-8b05-4096-8099-11e86a2508f7', 'volume_size': 1} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-512311851',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6347af88-8b05-4096-8099-11e86a2508f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:12Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Creating volume 6347af88-8b05-4096-8099-11e86a2508f7 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:12 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:12 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 1073741824 Jul 06 21:15:12 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:13 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 1073741824" returned: 0 in 1.140s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:13 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 Jul 06 21:15:13 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:14 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7" returned: 0 in 0.860s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] <== create_volume: return (2066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:15:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.069s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03272b74-9aa4-42c1-aaff-fbd5310f0bd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6347af88-8b05-4096-8099-11e86a2508f7', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089ff388-085a-4840-a96b-58f8816cd9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:14 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Volume volume-6347af88-8b05-4096-8099-11e86a2508f7 (6347af88-8b05-4096-8099-11e86a2508f7): created successfully Jul 06 21:15:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089ff388-085a-4840-a96b-58f8816cd9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (e92d4552-3eec-48b4-b556-059ff028d5d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-29ab217d-ef97-47aa-8042-44ebcd49b5bd tempest-VolumesActionsTest-1349342923 None] Created volume successfully. Jul 06 21:15:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-6347af88-8b05-4096-8099-11e86a2508f7-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Lock "cinder-6347af88-8b05-4096-8099-11e86a2508f7-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Acquiring lock "cinder-quobyte-6347af88-8b05-4096-8099-11e86a2508f7" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-6347af88-8b05-4096-8099-11e86a2508f7" acquired by "delete_volume" :: waited 0.013s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[623ea23b-e7a5-464a-8e11-f2a28f444578]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:15 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 Jul 06 21:15:15 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:16 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7" returned: 0 in 0.751s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:16 devstack sudo[96452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7 Jul 06 21:15:16 devstack sudo[96452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:17 devstack sudo[96452]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6347af88-8b05-4096-8099-11e86a2508f7" returned: 0 in 0.606s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Lock "cinder-quobyte-6347af88-8b05-4096-8099-11e86a2508f7" released by "delete_volume" :: held 1.391s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Created reservations ['04acb399-e7e3-48f6-a47f-e2cbccb96812', 'c3313d1d-0447-488c-bddf-f2b236893ea1', '2cc47985-6707-43c8-93a1-cbbedca246eb', '62e6cbf5-3bb2-4bf9-a896-fe3237032da6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:17 devstack sudo[96455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:17 devstack sudo[96455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:17 devstack sudo[96455]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.664s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Deleted volume successfully. Jul 06 21:15:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c5930354-8b78-4de2-8feb-7055b963b775 tempest-VolumesActionsTest-435685269 None] Lock "cinder-6347af88-8b05-4096-8099-11e86a2508f7-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (298f3fb2-3b9b-447b-a97b-a19af8a313b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56792c42-3c13-4d9b-87c4-49b62f03fb04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56792c42-3c13-4d9b-87c4-49b62f03fb04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-104626131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a97870f-c2b2-4183-a909-775b6ab59038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:18Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b93ade-c3cd-408c-a300-b4a4b27615c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (59b93ade-c3cd-408c-a300-b4a4b27615c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8571dccb-fc77-4883-817f-52103bdd939a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8571dccb-fc77-4883-817f-52103bdd939a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a97870f-c2b2-4183-a909-775b6ab59038', 'volume_name': 'volume-3a97870f-c2b2-4183-a909-775b6ab59038', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f442b811-e66b-4970-a7da-1b221d94b4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f442b811-e66b-4970-a7da-1b221d94b4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3567f060-e682-456a-9c70-a32621caae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:18 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Volume 3a97870f-c2b2-4183-a909-775b6ab59038: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a97870f-c2b2-4183-a909-775b6ab59038', 'volume_size': 1} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-104626131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a97870f-c2b2-4183-a909-775b6ab59038,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='352bdadd1d1d4567b1519347f8560abe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:18Z,use_quota=True,user_id='85e70f90aff44382be72e3985ab2cfdd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Creating volume 3a97870f-c2b2-4183-a909-775b6ab59038 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:18 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:18 devstack sudo[96459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 1073741824 Jul 06 21:15:18 devstack sudo[96459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:19 devstack sudo[96459]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 1073741824" returned: 0 in 0.899s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:19 devstack sudo[96466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 Jul 06 21:15:19 devstack sudo[96466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:19 devstack sudo[96466]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038" returned: 0 in 0.627s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] <== create_volume: return (1575ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:15:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:19 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3567f060-e682-456a-9c70-a32621caae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a97870f-c2b2-4183-a909-775b6ab59038', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:19 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00565224-9a95-4c4c-86a0-60147d91a070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Volume volume-3a97870f-c2b2-4183-a909-775b6ab59038 (3a97870f-c2b2-4183-a909-775b6ab59038): created successfully Jul 06 21:15:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00565224-9a95-4c4c-86a0-60147d91a070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Flow 'volume_create_manager' (298f3fb2-3b9b-447b-a97b-a19af8a313b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-261a2125-42d3-4157-92b0-f8cbec6af83e tempest-VolumesActionsTest-1349342923 None] Created volume successfully. Jul 06 21:15:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "cinder-3a97870f-c2b2-4183-a909-775b6ab59038-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-3a97870f-c2b2-4183-a909-775b6ab59038-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "cinder-quobyte-3a97870f-c2b2-4183-a909-775b6ab59038" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-quobyte-3a97870f-c2b2-4183-a909-775b6ab59038" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2239a23-3975-432e-b723-ef76d9f78bcb]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:21 devstack sudo[96470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 Jul 06 21:15:21 devstack sudo[96470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:21 devstack sudo[96470]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038" returned: 0 in 0.829s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:21 devstack sudo[96475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038 Jul 06 21:15:21 devstack sudo[96475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:22 devstack sudo[96475]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3a97870f-c2b2-4183-a909-775b6ab59038" returned: 0 in 0.826s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-quobyte-3a97870f-c2b2-4183-a909-775b6ab59038" released by "delete_volume" :: held 1.700s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Created reservations ['be50d93f-4a69-4a85-9fa9-22586fd76110', '08be1861-e942-4eef-9e85-1d8fe34e9fbb', 'c5cdd409-95f2-4509-b19b-0d59e54d524e', 'ff9b1e29-23bf-4505-8f87-849a4c6bb1c5'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:22 devstack sudo[96479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:22 devstack sudo[96479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:23 devstack sudo[96479]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.807s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:23 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:23 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Deleted volume successfully. Jul 06 21:15:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83c3e9af-1ea3-4a9c-bdcf-416d44f92909 tempest-VolumesActionsTest-1349342923 None] Lock "cinder-3a97870f-c2b2-4183-a909-775b6ab59038-delete_volume" released by "delete_volume" :: held 2.731s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Flow 'volume_create_manager' (d687eaa2-52f1-4532-8477-3d12d70f820f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b621ee6-67ca-4a85-aff7-f9829b35270d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6b621ee6-67ca-4a85-aff7-f9829b35270d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-927727653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1d3224-a448-4b5d-82dd-74ab79e8f32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a763f1ce68f40438e64355a1ae557a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:26Z,use_quota=True,user_id='6a83bc17d8594769b5eca213836d63d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dc370b-ee3a-49eb-82a0-008fb7b5915c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0dc370b-ee3a-49eb-82a0-008fb7b5915c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c4284-69c8-40cc-88ca-37558efd999d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2c7c4284-69c8-40cc-88ca-37558efd999d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe1d3224-a448-4b5d-82dd-74ab79e8f32b', 'volume_name': 'volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc61cc4e-88d2-4952-982f-7b4c59172ee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc61cc4e-88d2-4952-982f-7b4c59172ee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6a21e8-7271-4718-bd42-6e5c76ffea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:25 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Volume fe1d3224-a448-4b5d-82dd-74ab79e8f32b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b', 'volume_size': 1} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-927727653',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe1d3224-a448-4b5d-82dd-74ab79e8f32b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a763f1ce68f40438e64355a1ae557a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:26Z,use_quota=True,user_id='6a83bc17d8594769b5eca213836d63d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Creating volume fe1d3224-a448-4b5d-82dd-74ab79e8f32b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:25 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:25 devstack sudo[96486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b 1073741824 Jul 06 21:15:25 devstack sudo[96486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:26 devstack sudo[96486]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b 1073741824" returned: 0 in 1.033s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:26 devstack sudo[96492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b Jul 06 21:15:26 devstack sudo[96492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:27 devstack sudo[96492]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] <== create_volume: return (1866ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:15:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.868s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d6a21e8-7271-4718-bd42-6e5c76ffea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29334d39-8f67-44e6-9da1-d508d60ee169) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:27 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Volume volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b (fe1d3224-a448-4b5d-82dd-74ab79e8f32b): created successfully Jul 06 21:15:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (29334d39-8f67-44e6-9da1-d508d60ee169) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Flow 'volume_create_manager' (d687eaa2-52f1-4532-8477-3d12d70f820f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bdb53a59-9fb0-4ca2-8d3f-996803dc9742 tempest-AttachVolumeNegativeTest-429805347 None] Created volume successfully. Jul 06 21:15:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-20acc5ba-bbe9-4c59-86c8-ed7cc4a3762c req-bc97849b-6d25-46eb-a56a-42542711fa43 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-20acc5ba-bbe9-4c59-86c8-ed7cc4a3762c req-bc97849b-6d25-46eb-a56a-42542711fa43 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:30 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9155f83c-a320-484a-82f4-ae38f5a54fc1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-20acc5ba-bbe9-4c59-86c8-ed7cc4a3762c req-bc97849b-6d25-46eb-a56a-42542711fa43 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:31 devstack sudo[96512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b Jul 06 21:15:31 devstack sudo[96512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:31 devstack sudo[96512]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-20acc5ba-bbe9-4c59-86c8-ed7cc4a3762c req-bc97849b-6d25-46eb-a56a-42542711fa43 tempest-AttachVolumeNegativeTest-429805347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b" returned: 0 in 0.969s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-20acc5ba-bbe9-4c59-86c8-ed7cc4a3762c req-bc97849b-6d25-46eb-a56a-42542711fa43 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.995s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-20acc5ba-bbe9-4c59-86c8-ed7cc4a3762c req-bc97849b-6d25-46eb-a56a-42542711fa43 tempest-AttachVolumeNegativeTest-429805347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '28e5e470-6957-483f-afe8-04485576a653', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:15:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-20acc5ba-bbe9-4c59-86c8-ed7cc4a3762c req-bc97849b-6d25-46eb-a56a-42542711fa43 tempest-AttachVolumeNegativeTest-429805347 None] attachment_update completed successfully. Jul 06 21:15:38 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=81,cinder:SELECT=57,cinder:INSERT=20,cinder:DELETE=7 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:15:38 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=68,cinder:UPDATE=84,cinder:DELETE=7,cinder:INSERT=17 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Flow 'volume_create_manager' (861c5971-d84f-497e-808c-cb8b21919d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d80ea7-4781-40ce-bee9-1bd305e4db05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5d80ea7-4781-40ce-bee9-1bd305e4db05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-760306371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810f912d-b806-4e20-bd42-281a78fbfcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f097e4ec0c4aad91cf09e2f119878e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:39Z,use_quota=True,user_id='d05b9d0e7e8c42e78a4ade388b7abe57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703a14cc-a87d-4827-a1fd-960d564c377e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (703a14cc-a87d-4827-a1fd-960d564c377e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0cc976-8c33-4d94-8a7e-21d01b223c56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f0cc976-8c33-4d94-8a7e-21d01b223c56) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '810f912d-b806-4e20-bd42-281a78fbfcc2', 'volume_name': 'volume-810f912d-b806-4e20-bd42-281a78fbfcc2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5f5bf5-9846-465e-a890-dfc3fca9eb9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d5f5bf5-9846-465e-a890-dfc3fca9eb9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27330d58-66ee-4a12-89d1-0a6618aeec17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:39 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Volume 810f912d-b806-4e20-bd42-281a78fbfcc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-810f912d-b806-4e20-bd42-281a78fbfcc2', 'volume_size': 1} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-760306371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=810f912d-b806-4e20-bd42-281a78fbfcc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a0f097e4ec0c4aad91cf09e2f119878e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:39Z,use_quota=True,user_id='d05b9d0e7e8c42e78a4ade388b7abe57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Creating volume 810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:39 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:39 devstack sudo[96901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 1073741824 Jul 06 21:15:39 devstack sudo[96901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:40 devstack sudo[96901]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 1073741824" returned: 0 in 0.986s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:40 devstack sudo[96907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 Jul 06 21:15:40 devstack sudo[96907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:40 devstack sudo[96907]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2" returned: 0 in 0.704s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] <== create_volume: return (1739ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.743s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27330d58-66ee-4a12-89d1-0a6618aeec17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-810f912d-b806-4e20-bd42-281a78fbfcc2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbe351e-f2d6-4b57-8547-d9c50fbea964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:40 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Volume volume-810f912d-b806-4e20-bd42-281a78fbfcc2 (810f912d-b806-4e20-bd42-281a78fbfcc2): created successfully Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fbe351e-f2d6-4b57-8547-d9c50fbea964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Flow 'volume_create_manager' (861c5971-d84f-497e-808c-cb8b21919d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:40 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a270aa33-96c7-4278-911f-194096777c35 tempest-SnapshotMetadataTestJSON-1888270865 None] Created volume successfully. Jul 06 21:15:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Creating offline snapshot 684917b3-e81f-4787-a5eb-71c73fff6c29 of volume 810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:15:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8389cd9-d748-495e-ba26-acb225b83e8d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:41 devstack sudo[96910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 Jul 06 21:15:41 devstack sudo[96910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:42 devstack sudo[96910]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2" returned: 0 in 0.988s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:42 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 1G Jul 06 21:15:42 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:43 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 1G" returned: 0 in 1.002s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-810f912d-b806-4e20-bd42-281a78fbfcc2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:43 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-810f912d-b806-4e20-bd42-281a78fbfcc2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 Jul 06 21:15:43 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:44 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-810f912d-b806-4e20-bd42-281a78fbfcc2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29" returned: 0 in 0.777s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:44 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 is being set with open permissions: ugo+rw Jul 06 21:15:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:44 devstack sudo[96937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 Jul 06 21:15:44 devstack sudo[96937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:44 devstack sudo[96937]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29" returned: 0 in 0.719s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:44 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.info Jul 06 21:15:44 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:45 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.info" returned: 0 in 0.692s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:45 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.info is being set with open permissions: ugo+rw Jul 06 21:15:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:45 devstack sudo[96943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.info Jul 06 21:15:45 devstack sudo[96943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:46 devstack sudo[96943]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.info" returned: 0 in 0.889s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.170s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-08c31efa-ba9b-4546-a8bd-f9bab8767d44 tempest-SnapshotMetadataTestJSON-1888270865 None] Create snapshot completed successfully Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "cinder-684917b3-e81f-4787-a5eb-71c73fff6c29-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-684917b3-e81f-4787-a5eb-71c73fff6c29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "cinder-quobyte-810f912d-b806-4e20-bd42-281a78fbfcc2" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-quobyte-810f912d-b806-4e20-bd42-281a78fbfcc2" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "cinder-quobyte-684917b3-e81f-4787-a5eb-71c73fff6c29" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-quobyte-684917b3-e81f-4787-a5eb-71c73fff6c29" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Deleting offline snapshot 684917b3-e81f-4787-a5eb-71c73fff6c29 of volume 810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] snapshot_file for this snap is: volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c1363a0-d95e-4182-9586-870fa4fb5e6e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:48 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 Jul 06 21:15:48 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:49 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29" returned: 0 in 0.926s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-810f912d-b806-4e20-bd42-281a78fbfcc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:15:49 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[497c6f8c-3dfc-4926-81d6-6c0eea52b96c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:49 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 Jul 06 21:15:49 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:50 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2" returned: 0 in 0.894s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:50 devstack sudo[96994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 Jul 06 21:15:50 devstack sudo[96994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:51 devstack sudo[96994]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29" returned: 0 in 0.982s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:51 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29 Jul 06 21:15:51 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:52 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2.684917b3-e81f-4787-a5eb-71c73fff6c29" returned: 0 in 0.808s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-quobyte-684917b3-e81f-4787-a5eb-71c73fff6c29" released by "_delete_snapshot" :: held 3.768s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-quobyte-810f912d-b806-4e20-bd42-281a78fbfcc2" released by "delete_snapshot" :: held 3.795s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Created reservations ['2589ff7f-30a7-40b1-b9da-eb337862b023', '4d6f26c5-c2d1-43a8-b3e1-5b28220f3deb', '187985e7-546a-4d9c-a973-67928a9071a5', '112652f1-92de-4589-9ba5-29ca3511f7f1'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:52 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Delete snapshot completed successfully. Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2f29d8c5-05c1-48e4-abed-9de546a5f451 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-684917b3-e81f-4787-a5eb-71c73fff6c29-delete_snapshot" released by "delete_snapshot" :: held 3.966s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "cinder-810f912d-b806-4e20-bd42-281a78fbfcc2-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-810f912d-b806-4e20-bd42-281a78fbfcc2-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "cinder-quobyte-810f912d-b806-4e20-bd42-281a78fbfcc2" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-quobyte-810f912d-b806-4e20-bd42-281a78fbfcc2" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0828aa0-6f9c-4b90-9dfe-7cef1decdea1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:15:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:52 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 Jul 06 21:15:52 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:53 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2" returned: 0 in 0.807s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:53 devstack sudo[97051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2 Jul 06 21:15:53 devstack sudo[97051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:54 devstack sudo[97051]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-810f912d-b806-4e20-bd42-281a78fbfcc2" returned: 0 in 0.688s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-quobyte-810f912d-b806-4e20-bd42-281a78fbfcc2" released by "delete_volume" :: held 1.558s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Created reservations ['a57ce583-7539-47f9-9ccb-f2e575a645c6', '658f23d4-cded-4cb8-9979-f6983473a347', '65df9693-e560-4cba-98a4-78ddfc5df720', 'fd4398a1-a070-49d9-9e19-12d061bc8298'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:54 devstack sudo[97054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:15:54 devstack sudo[97054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:55 devstack sudo[97054]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.906s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:15:55 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Deleted volume successfully. Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d3f9d54-21cf-4570-a326-9a757deb4be6 tempest-SnapshotMetadataTestJSON-1888270865 None] Lock "cinder-810f912d-b806-4e20-bd42-281a78fbfcc2-delete_volume" released by "delete_volume" :: held 2.790s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Flow 'volume_create_manager' (baeea550-72b3-4562-9b11-2bbe9a9a29c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c167cd-aed5-4359-b039-4009f7b4b820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65c167cd-aed5-4359-b039-4009f7b4b820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1879521840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d550d122-aa24-476a-b115-6182c0fd5305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff4ae41ffd94fd18b938e9950770c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:56Z,use_quota=True,user_id='89315444bc2740a985a588486ec7ca64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b5736f-0bf1-47fb-b9c8-e220102e72f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c0b5736f-0bf1-47fb-b9c8-e220102e72f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbbe392-4680-4aac-94a2-6cfb524fe7b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bbbe392-4680-4aac-94a2-6cfb524fe7b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd550d122-aa24-476a-b115-6182c0fd5305', 'volume_name': 'volume-d550d122-aa24-476a-b115-6182c0fd5305', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efe1b69-b7e5-4ee5-a4a4-510adf421cbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2efe1b69-b7e5-4ee5-a4a4-510adf421cbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d0ccc9-063f-4a40-8d99-c46d54da21dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:55 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Volume d550d122-aa24-476a-b115-6182c0fd5305: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d550d122-aa24-476a-b115-6182c0fd5305', 'volume_size': 1} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1879521840',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d550d122-aa24-476a-b115-6182c0fd5305,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff4ae41ffd94fd18b938e9950770c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:56Z,use_quota=True,user_id='89315444bc2740a985a588486ec7ca64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Creating volume d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:55 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:55 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 1073741824 Jul 06 21:15:55 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:57 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 1073741824" returned: 0 in 1.178s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:57 devstack sudo[97114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:15:57 devstack sudo[97114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:15:58 devstack sudo[97114]: pam_unix(sudo:session): session closed for user root Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 0.943s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] <== create_volume: return (2213ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.217s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9d0ccc9-063f-4a40-8d99-c46d54da21dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d550d122-aa24-476a-b115-6182c0fd5305', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e502d9e-2d57-4d2e-aabe-386de6dcae69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:58 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Volume volume-d550d122-aa24-476a-b115-6182c0fd5305 (d550d122-aa24-476a-b115-6182c0fd5305): created successfully Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e502d9e-2d57-4d2e-aabe-386de6dcae69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Flow 'volume_create_manager' (baeea550-72b3-4562-9b11-2bbe9a9a29c7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-aee9b442-6dad-4cad-bc4f-9a027d2a0c23 tempest-TestStampPattern-1850900608 None] Created volume successfully. Jul 06 21:15:58 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Flow 'volume_create_manager' (f49be545-50c4-44af-beb0-b9d6aff3f8c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b35b61-a66c-47ef-b0e2-03f21f60663d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b35b61-a66c-47ef-b0e2-03f21f60663d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2124152521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9823848-786c-4975-98a9-9ff817f81a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196200b65002421b9ee3b83d32c13737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:59Z,use_quota=True,user_id='784fcce41699470c904d4fc405d97dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576948bc-f766-4996-8be6-d49a500baa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (576948bc-f766-4996-8be6-d49a500baa59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82af1ec-c92f-443b-83b5-42fdbbb33b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d82af1ec-c92f-443b-83b5-42fdbbb33b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9823848-786c-4975-98a9-9ff817f81a47', 'volume_name': 'volume-e9823848-786c-4975-98a9-9ff817f81a47', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a69578-c770-4e58-8daa-2f558b3a2570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (15a69578-c770-4e58-8daa-2f558b3a2570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dbc7fa-8d0f-4117-b1b9-d5300719b0f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:15:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Volume e9823848-786c-4975-98a9-9ff817f81a47: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9823848-786c-4975-98a9-9ff817f81a47', 'volume_size': 1} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:15:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2124152521',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9823848-786c-4975-98a9-9ff817f81a47,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196200b65002421b9ee3b83d32c13737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:15:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:15:59Z,use_quota=True,user_id='784fcce41699470c904d4fc405d97dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Creating volume e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:15:59 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:15:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:15:59 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 1073741824 Jul 06 21:15:59 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:00 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 1073741824" returned: 0 in 1.064s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:00 devstack sudo[97130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 Jul 06 21:16:00 devstack sudo[97130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:01 devstack sudo[97130]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47" returned: 0 in 0.797s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10dbc7fa-8d0f-4117-b1b9-d5300719b0f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9823848-786c-4975-98a9-9ff817f81a47', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a6e003-8a5b-4db6-9530-1e3434fa3c53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:01 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Volume volume-e9823848-786c-4975-98a9-9ff817f81a47 (e9823848-786c-4975-98a9-9ff817f81a47): created successfully Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55a6e003-8a5b-4db6-9530-1e3434fa3c53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Flow 'volume_create_manager' (f49be545-50c4-44af-beb0-b9d6aff3f8c8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:16:01 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4d650713-6e08-43f3-80aa-ab636931d2a4 tempest-VolumesDeleteCascade-784998240 None] Created volume successfully. Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:01 devstack sudo[97134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:16:01 devstack sudo[97134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:01 devstack sudo[97134]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.686s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:16:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:16:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Creating offline snapshot bde38a85-1433-499f-b37d-391279565cb8 of volume e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:16:02 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed726c2b-c0f6-4f09-a711-be4a3324822c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:02 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 Jul 06 21:16:02 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:03 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47" returned: 0 in 1.078s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:03 devstack sudo[97144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 1G Jul 06 21:16:03 devstack sudo[97144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:04 devstack sudo[97144]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 1G" returned: 0 in 1.070s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9823848-786c-4975-98a9-9ff817f81a47 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:04 devstack sudo[97165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9823848-786c-4975-98a9-9ff817f81a47 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 Jul 06 21:16:04 devstack sudo[97165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:05 devstack sudo[97165]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9823848-786c-4975-98a9-9ff817f81a47 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8" returned: 0 in 0.706s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:05 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 is being set with open permissions: ugo+rw Jul 06 21:16:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:05 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 Jul 06 21:16:05 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:06 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8" returned: 0 in 0.635s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:06 devstack sudo[97175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.info Jul 06 21:16:06 devstack sudo[97175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:06 devstack sudo[97175]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.info" returned: 0 in 0.702s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:06 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.info is being set with open permissions: ugo+rw Jul 06 21:16:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:06 devstack sudo[97178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.info Jul 06 21:16:06 devstack sudo[97178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:07 devstack sudo[97178]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.info" returned: 0 in 1.038s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.357s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c3104a33-8eb8-4925-8c92-ebbde8a1ad2b tempest-VolumesDeleteCascade-784998240 None] Create snapshot completed successfully Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Creating offline snapshot 43868e83-252c-4786-95eb-4dafb1cddc4d of volume e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6ad3c2-6654-4c6a-b26b-e95ffae0af73]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:09 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 Jul 06 21:16:09 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:09 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8" returned: 0 in 0.896s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9823848-786c-4975-98a9-9ff817f81a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:16:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:09 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d 1G Jul 06 21:16:09 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:10 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d 1G" returned: 0 in 0.937s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:10 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d Jul 06 21:16:10 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:11 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:11 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d is being set with open permissions: ugo+rw Jul 06 21:16:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:11 devstack sudo[97280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d Jul 06 21:16:11 devstack sudo[97280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:12 devstack sudo[97280]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d" returned: 0 in 0.746s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.472s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e9911bf1-024c-40fc-b75f-36eb0f8014c5 tempest-VolumesDeleteCascade-784998240 None] Create snapshot completed successfully Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-e9823848-786c-4975-98a9-9ff817f81a47-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-e9823848-786c-4975-98a9-9ff817f81a47-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Performing cascade delete. {{(pid=87273) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-43868e83-252c-4786-95eb-4dafb1cddc4d-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-43868e83-252c-4786-95eb-4dafb1cddc4d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-43868e83-252c-4786-95eb-4dafb1cddc4d" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-43868e83-252c-4786-95eb-4dafb1cddc4d" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Deleting offline snapshot 43868e83-252c-4786-95eb-4dafb1cddc4d of volume e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] snapshot_file for this snap is: volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd9a59c3-d5ba-446a-8a75-5313b85a9299]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:13 devstack sudo[97283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d Jul 06 21:16:13 devstack sudo[97283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:14 devstack sudo[97283]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d" returned: 0 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9823848-786c-4975-98a9-9ff817f81a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:16:14 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[46c30b5a-5013-4345-acea-801fa248dbd3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:14 devstack sudo[97289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 Jul 06 21:16:14 devstack sudo[97289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:15 devstack sudo[97289]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9823848-786c-4975-98a9-9ff817f81a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:16:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:15 devstack sudo[97295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d Jul 06 21:16:15 devstack sudo[97295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:16 devstack sudo[97295]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d" returned: 0 in 0.853s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:16 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d Jul 06 21:16:16 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:16 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.43868e83-252c-4786-95eb-4dafb1cddc4d" returned: 0 in 0.686s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-43868e83-252c-4786-95eb-4dafb1cddc4d" released by "_delete_snapshot" :: held 3.293s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" released by "delete_snapshot" :: held 3.329s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Created reservations ['ebaf59c9-e098-4740-b542-dcbe523400ca', '45ebb1fc-a1de-4221-9577-ac327929489c', 'e3f0a89e-fe07-4127-9a5d-203c49960b3d', '29af1e86-08bb-451a-b801-370507c6cdce'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:16:16 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Delete snapshot completed successfully. Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-43868e83-252c-4786-95eb-4dafb1cddc4d-delete_snapshot" released by "delete_snapshot" :: held 3.518s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-bde38a85-1433-499f-b37d-391279565cb8-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-bde38a85-1433-499f-b37d-391279565cb8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-bde38a85-1433-499f-b37d-391279565cb8" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-bde38a85-1433-499f-b37d-391279565cb8" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Deleting offline snapshot bde38a85-1433-499f-b37d-391279565cb8 of volume e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] snapshot_file for this snap is: volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6dcd821-9b4b-4db2-8519-d72a76f47d86]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:17 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 Jul 06 21:16:17 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:17 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8" returned: 0 in 0.816s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e9823848-786c-4975-98a9-9ff817f81a47(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf2e06e-f061-4a10-8c7b-d42ff2e06351]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:18 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 Jul 06 21:16:18 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:18 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:18 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 Jul 06 21:16:18 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:19 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8" returned: 0 in 0.748s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:19 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8 Jul 06 21:16:19 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:20 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47.bde38a85-1433-499f-b37d-391279565cb8" returned: 0 in 0.704s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-bde38a85-1433-499f-b37d-391279565cb8" released by "_delete_snapshot" :: held 3.178s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" released by "delete_snapshot" :: held 3.210s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Created reservations ['3e4747cf-74a8-4410-90ea-6ebbe20cc29a', '5d15e47f-47ef-4d37-a14f-8a465eda2585', '9b16d051-cd9b-4451-a1de-aa0fe1c8c46a', 'feeb6cdf-1e18-41ca-8a84-b2b2fa95b2d9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:16:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Delete snapshot completed successfully. Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-bde38a85-1433-499f-b37d-391279565cb8-delete_snapshot" released by "delete_snapshot" :: held 3.378s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Snapshots deleted, issuing volume delete {{(pid=87273) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfdaab1e-6e49-4658-9d39-4c4d07705a91]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:20 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 Jul 06 21:16:20 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:21 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47" returned: 0 in 0.832s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:21 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47 Jul 06 21:16:21 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:21 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9823848-786c-4975-98a9-9ff817f81a47" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-e9823848-786c-4975-98a9-9ff817f81a47" released by "delete_volume" :: held 1.570s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:21 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Created reservations ['57bffc86-deb7-4f1c-b476-efde816466fd', '35dd72bf-3b22-4dc5-85f6-a318ab0490ef', '16f57da5-0754-4aee-aada-7aedc00ae98d', 'faab83ec-5dcb-4c03-b1fe-b64ecfd2c847'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:22 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:16:22 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:22 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.752s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:16:22 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Deleted volume successfully. Jul 06 21:16:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b76cba03-eab7-4182-be67-bf228fa99574 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-e9823848-786c-4975-98a9-9ff817f81a47-delete_volume" released by "delete_volume" :: held 9.517s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Flow 'volume_create_manager' (23d823e8-8b3e-4363-a2be-bd1b526f4047) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c8462-cff7-46c8-81ab-f9c071b188fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (048c8462-cff7-46c8-81ab-f9c071b188fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167701444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba09e22-aebd-4698-a4b9-ab7643296d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196200b65002421b9ee3b83d32c13737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:16:24Z,use_quota=True,user_id='784fcce41699470c904d4fc405d97dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4f1818-385a-40cb-9da6-81bbb2afe5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cd4f1818-385a-40cb-9da6-81bbb2afe5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7430a9fe-b3eb-43fa-8bb6-79a55c30dab8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7430a9fe-b3eb-43fa-8bb6-79a55c30dab8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9ba09e22-aebd-4698-a4b9-ab7643296d8a', 'volume_name': 'volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca4532e-2ae1-4e5e-ba62-108b6f240ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aca4532e-2ae1-4e5e-ba62-108b6f240ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c594e8-15b6-4188-b5d4-a48ece8467e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Volume 9ba09e22-aebd-4698-a4b9-ab7643296d8a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a', 'volume_size': 1} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:16:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1167701444',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9ba09e22-aebd-4698-a4b9-ab7643296d8a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196200b65002421b9ee3b83d32c13737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:16:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:16:24Z,use_quota=True,user_id='784fcce41699470c904d4fc405d97dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Creating volume 9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:16:23 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:16:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:23 devstack sudo[97377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a 1073741824 Jul 06 21:16:23 devstack sudo[97377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:24 devstack sudo[97377]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a 1073741824" returned: 0 in 0.849s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:24 devstack sudo[97399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a Jul 06 21:16:24 devstack sudo[97399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:25 devstack sudo[97399]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a" returned: 0 in 0.636s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] <== create_volume: return (1532ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:16:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.535s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32c594e8-15b6-4188-b5d4-a48ece8467e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00333aa0-100f-44ea-9930-61ff9cfd934f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:25 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Volume volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a (9ba09e22-aebd-4698-a4b9-ab7643296d8a): created successfully Jul 06 21:16:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00333aa0-100f-44ea-9930-61ff9cfd934f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Flow 'volume_create_manager' (23d823e8-8b3e-4363-a2be-bd1b526f4047) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:16:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5f3740ba-2ee6-46bd-9116-c548bd6f3d13 tempest-VolumesDeleteCascade-784998240 None] Created volume successfully. Jul 06 21:16:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Creating offline snapshot 60cabecc-2713-47fc-b537-32da5df0a878 of volume 9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:16:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[300ad4ae-68f2-44f0-8466-c41dcbd33795]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:26 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a Jul 06 21:16:26 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:26 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:26 devstack sudo[97407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 1G Jul 06 21:16:26 devstack sudo[97407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:27 devstack sudo[97407]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 1G" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:27 devstack sudo[97412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 Jul 06 21:16:27 devstack sudo[97412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:28 devstack sudo[97412]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878" returned: 0 in 0.705s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:28 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 is being set with open permissions: ugo+rw Jul 06 21:16:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:28 devstack sudo[97419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 Jul 06 21:16:28 devstack sudo[97419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:29 devstack sudo[97419]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:29 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.info Jul 06 21:16:29 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:29 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.info" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:29 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.info is being set with open permissions: ugo+rw Jul 06 21:16:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:29 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.info Jul 06 21:16:29 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:30 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.info" returned: 0 in 0.633s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.332s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7ed29cfe-edf9-4b69-a137-b58d7423b2f2 tempest-VolumesDeleteCascade-784998240 None] Create snapshot completed successfully Jul 06 21:16:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-70d1ac25-11aa-4304-a0be-3aceeb1edaa4 req-025b41e3-4bbc-44d6-a24c-93803717396e tempest-AttachVolumeNegativeTest-429805347 None] Terminate volume connection completed successfully. Jul 06 21:16:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-70d1ac25-11aa-4304-a0be-3aceeb1edaa4 req-025b41e3-4bbc-44d6-a24c-93803717396e tempest-AttachVolumeNegativeTest-429805347 None] Deleting attachment 28e5e470-6957-483f-afe8-04485576a653. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Flow 'volume_create_manager' (55ba46fd-4fe1-4f0d-a3eb-60ae9a764bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de88b91-ee74-4ca3-bd65-221d0a020589) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0de88b91-ee74-4ca3-bd65-221d0a020589) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:16:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1704917197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3cebc44c-1f92-4ff6-a1e9-313d993bb225,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='196200b65002421b9ee3b83d32c13737',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:16:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=60cabecc-2713-47fc-b537-32da5df0a878,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:16:32Z,use_quota=True,user_id='784fcce41699470c904d4fc405d97dca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1631cd-0335-4d0c-9a24-f2d3dbe622a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1631cd-0335-4d0c-9a24-f2d3dbe622a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e97e11d-a1a4-4a7e-966f-d8ac760969fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e97e11d-a1a4-4a7e-966f-d8ac760969fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3cebc44c-1f92-4ff6-a1e9-313d993bb225', 'volume_name': 'volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225', 'volume_size': 1, 'snapshot_id': '60cabecc-2713-47fc-b537-32da5df0a878'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22878f5b-d412-49fc-bc58-9e3216e7f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22878f5b-d412-49fc-bc58-9e3216e7f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b935ed68-61f7-4282-9626-3081bec85477) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:31 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Volume 3cebc44c-1f92-4ff6-a1e9-313d993bb225: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225', 'volume_size': 1, 'snapshot_id': '60cabecc-2713-47fc-b537-32da5df0a878'} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-60cabecc-2713-47fc-b537-32da5df0a878-3cebc44c-1f92-4ff6-a1e9-313d993bb225" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-60cabecc-2713-47fc-b537-32da5df0a878-3cebc44c-1f92-4ff6-a1e9-313d993bb225" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Creating volume 3cebc44c-1f92-4ff6-a1e9-313d993bb225 from snapshot 60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-3cebc44c-1f92-4ff6-a1e9-313d993bb225" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-3cebc44c-1f92-4ff6-a1e9-313d993bb225" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] snapshot: 60cabecc-2713-47fc-b537-32da5df0a878, volume: 3cebc44c-1f92-4ff6-a1e9-313d993bb225, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e818538-2eaf-4812-946d-88e276a8252f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:32 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 Jul 06 21:16:32 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:32 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878" returned: 0 in 0.804s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[905eda51-8ebe-4fda-a580-162b8fb15e77]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:33 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a Jul 06 21:16:33 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:33 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:33 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:16:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:33 devstack sudo[97443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 Jul 06 21:16:33 devstack sudo[97443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:39 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=51,cinder:UPDATE=53,cinder:INSERT=13,cinder:DELETE=6 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:16:39 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=48,cinder:SELECT=51,cinder:DELETE=4,cinder:INSERT=14 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:16:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-160430cb-7c14-415f-88cc-d5a1bc5b81e5 req-5ed2ed9c-3da9-465e-ad59-03918b96be34 tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:39 devstack sudo[97443]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225" returned: 0 in 6.121s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:39 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7d11fa6-465e-44a8-be5d-960a6e97cdeb]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:39 devstack sudo[97497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a Jul 06 21:16:39 devstack sudo[97497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:40 devstack sudo[97497]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a" returned: 0 in 0.937s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:40 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a, size 1024.00 MB, duration 6.12 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:16:40 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Converted 1024.00 MB image at 167.25 MB/s Jul 06 21:16:40 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 is being set with open permissions: ugo+rw Jul 06 21:16:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:40 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 Jul 06 21:16:40 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:41 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-3cebc44c-1f92-4ff6-a1e9-313d993bb225" released by "_copy_volume_from_snapshot" :: held 9.417s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-60cabecc-2713-47fc-b537-32da5df0a878-3cebc44c-1f92-4ff6-a1e9-313d993bb225" released by "_create_volume_from_snapshot" :: held 9.450s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.473s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-160430cb-7c14-415f-88cc-d5a1bc5b81e5 req-5ed2ed9c-3da9-465e-ad59-03918b96be34 tempest-TestStampPattern-1850900608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.835s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f6fe4f4-5c0f-4691-a2bf-454195089b27]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-160430cb-7c14-415f-88cc-d5a1bc5b81e5 req-5ed2ed9c-3da9-465e-ad59-03918b96be34 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b935ed68-61f7-4282-9626-3081bec85477) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225', 'volume_size': 1, 'snapshot_id': '60cabecc-2713-47fc-b537-32da5df0a878'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4678e-fa3f-480c-8281-2daf4f4d4c43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:41 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Volume volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 (3cebc44c-1f92-4ff6-a1e9-313d993bb225): created successfully Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (33a4678e-fa3f-480c-8281-2daf4f4d4c43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Flow 'volume_create_manager' (55ba46fd-4fe1-4f0d-a3eb-60ae9a764bfc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:16:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e2dddf4f-a4bc-4bf9-925b-652113aaae3f tempest-VolumesDeleteCascade-784998240 None] Created volume successfully. Jul 06 21:16:41 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:16:41 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-9ba09e22-aebd-4698-a4b9-ab7643296d8a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-9ba09e22-aebd-4698-a4b9-ab7643296d8a-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Performing cascade delete. {{(pid=87273) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-60cabecc-2713-47fc-b537-32da5df0a878-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-60cabecc-2713-47fc-b537-32da5df0a878-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-9ba09e22-aebd-4698-a4b9-ab7643296d8a" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-9ba09e22-aebd-4698-a4b9-ab7643296d8a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-60cabecc-2713-47fc-b537-32da5df0a878" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-60cabecc-2713-47fc-b537-32da5df0a878" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Deleting offline snapshot 60cabecc-2713-47fc-b537-32da5df0a878 of volume 9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] snapshot_file for this snap is: volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d4e1d93-2489-4569-bc16-aac0e87e3853]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:42 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-160430cb-7c14-415f-88cc-d5a1bc5b81e5 req-5ed2ed9c-3da9-465e-ad59-03918b96be34 tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 0.814s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-160430cb-7c14-415f-88cc-d5a1bc5b81e5 req-5ed2ed9c-3da9-465e-ad59-03918b96be34 tempest-TestStampPattern-1850900608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.834s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-160430cb-7c14-415f-88cc-d5a1bc5b81e5 req-5ed2ed9c-3da9-465e-ad59-03918b96be34 tempest-TestStampPattern-1850900608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-d550d122-aa24-476a-b115-6182c0fd5305', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '03a01194-6d32-480a-a799-3a229547539d', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:16:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-160430cb-7c14-415f-88cc-d5a1bc5b81e5 req-5ed2ed9c-3da9-465e-ad59-03918b96be34 tempest-TestStampPattern-1850900608 None] attachment_update completed successfully. Jul 06 21:16:42 devstack sudo[97511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 Jul 06 21:16:42 devstack sudo[97511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:43 devstack sudo[97511]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878" returned: 0 in 0.836s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:16:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a56b362-3328-48aa-a419-5066974882ad]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:43 devstack sudo[97584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a Jul 06 21:16:43 devstack sudo[97584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:44 devstack sudo[97584]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a" returned: 0 in 0.862s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:44 devstack sudo[97905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 Jul 06 21:16:44 devstack sudo[97905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:44 devstack sudo[97905]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878" returned: 0 in 0.847s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:44 devstack sudo[97917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878 Jul 06 21:16:44 devstack sudo[97917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:45 devstack sudo[97917]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a.60cabecc-2713-47fc-b537-32da5df0a878" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-60cabecc-2713-47fc-b537-32da5df0a878" released by "_delete_snapshot" :: held 3.325s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-9ba09e22-aebd-4698-a4b9-ab7643296d8a" released by "delete_snapshot" :: held 3.347s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Created reservations ['b1aff050-4943-49ed-a2db-90017807b423', '73f5f6a2-4cd0-4d7f-a286-9a718e973135', '48596eb3-e469-4173-8a75-c3bfb227f677', 'd3d8cff6-7baf-464d-a154-dda8209004e5'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:16:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Delete snapshot completed successfully. Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-60cabecc-2713-47fc-b537-32da5df0a878-delete_snapshot" released by "delete_snapshot" :: held 3.529s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Snapshots deleted, issuing volume delete {{(pid=87273) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-9ba09e22-aebd-4698-a4b9-ab7643296d8a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-9ba09e22-aebd-4698-a4b9-ab7643296d8a" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b029d32f-7003-49f2-a6ee-cbb43ad8b746]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:45 devstack sudo[97920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a Jul 06 21:16:45 devstack sudo[97920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:46 devstack sudo[97920]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a" returned: 0 in 0.853s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:46 devstack sudo[97962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a Jul 06 21:16:46 devstack sudo[97962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:47 devstack sudo[97962]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9ba09e22-aebd-4698-a4b9-ab7643296d8a" returned: 0 in 0.765s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-9ba09e22-aebd-4698-a4b9-ab7643296d8a" released by "delete_volume" :: held 1.684s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Created reservations ['b6e4b8b6-d0cf-48c8-bb7b-24208849a416', 'a082868b-2ccb-4228-8914-4da1585e69c2', '2827df11-b21b-4a87-a7db-6b11a8bf2693', '5ccc3378-f31c-44bb-8684-a87d1057bc6a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:47 devstack sudo[97971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:16:47 devstack sudo[97971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-3cebc44c-1f92-4ff6-a1e9-313d993bb225-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-3cebc44c-1f92-4ff6-a1e9-313d993bb225-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "cinder-quobyte-3cebc44c-1f92-4ff6-a1e9-313d993bb225" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-3cebc44c-1f92-4ff6-a1e9-313d993bb225" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[859dbe47-1185-418b-8694-96c8aa777dee]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:48 devstack sudo[97979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 Jul 06 21:16:48 devstack sudo[97979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:48 devstack sudo[97971]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.718s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:48 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:16:48 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Deleted volume successfully. Jul 06 21:16:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-44e14914-f94d-4d93-85ec-15f729716e51 tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-9ba09e22-aebd-4698-a4b9-ab7643296d8a-delete_volume" released by "delete_volume" :: held 6.202s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:48 devstack sudo[97979]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225" returned: 0 in 0.902s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:48 devstack sudo[97986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225 Jul 06 21:16:48 devstack sudo[97986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:49 devstack sudo[97986]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3cebc44c-1f92-4ff6-a1e9-313d993bb225" returned: 0 in 0.751s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-quobyte-3cebc44c-1f92-4ff6-a1e9-313d993bb225" released by "delete_volume" :: held 1.728s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Created reservations ['7498c2e4-ca37-41a5-81c8-189e32d73804', '4c4812c9-385c-462e-834d-cf32a61a89cf', 'c3b1ef52-10de-465a-946f-45b602ba1bc0', '486baeb1-a210-499d-b975-3f93653d0d7c'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:49 devstack sudo[97995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:16:49 devstack sudo[97995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:50 devstack sudo[97995]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:50 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:16:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Deleted volume successfully. Jul 06 21:16:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c8339a21-97ea-4a6f-a0b0-7190effa239c tempest-VolumesDeleteCascade-784998240 None] Lock "cinder-3cebc44c-1f92-4ff6-a1e9-313d993bb225-delete_volume" released by "delete_volume" :: held 2.733s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:16:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-76bc642e-c67a-4853-90fa-58954fef61b5 req-49125905-c1be-4a5d-ba4b-370b8c592948 tempest-TestStampPattern-1850900608 None] Terminate volume connection completed successfully. Jul 06 21:16:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-76bc642e-c67a-4853-90fa-58954fef61b5 req-49125905-c1be-4a5d-ba4b-370b8c592948 tempest-TestStampPattern-1850900608 None] Deleting attachment 03a01194-6d32-480a-a799-3a229547539d. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:16:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Creating offline snapshot c8b7852f-213d-4b96-bf2a-9a934aaa4437 of volume d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:16:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d683a84-c902-4a88-8971-a6ea92d92666]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:16:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:54 devstack sudo[98047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:16:54 devstack sudo[98047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:55 devstack sudo[98047]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 0.838s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:55 devstack sudo[98052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 1G Jul 06 21:16:55 devstack sudo[98052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Flow 'volume_create_manager' (eb06d8fe-a7d8-4d6b-bb84-b2a41e8bf29d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cc9df0-4e45-4279-ad39-ea09a668f1ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1cc9df0-4e45-4279-ad39-ea09a668f1ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1462640274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51923e26-8c78-43b8-aec6-4ea19299702f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d144d60af2e473abee6c1a50d24b027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:16:55Z,use_quota=True,user_id='8023c0761be04501aef8dee0b19d0096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab0b4d1-fd63-48d2-9a2a-d4acb3d9b7ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ab0b4d1-fd63-48d2-9a2a-d4acb3d9b7ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728fb0e0-4edf-4c39-a7c9-a08ef437d2e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (728fb0e0-4edf-4c39-a7c9-a08ef437d2e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51923e26-8c78-43b8-aec6-4ea19299702f', 'volume_name': 'volume-51923e26-8c78-43b8-aec6-4ea19299702f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf82751-36e0-4d0a-b167-28e02c3d72e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bbf82751-36e0-4d0a-b167-28e02c3d72e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4132a-ab13-4357-8ff2-5573dabf5e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:16:55 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Volume 51923e26-8c78-43b8-aec6-4ea19299702f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51923e26-8c78-43b8-aec6-4ea19299702f', 'volume_size': 1} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:55 devstack sudo[98052]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 1G" returned: 0 in 0.864s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d550d122-aa24-476a-b115-6182c0fd5305 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:55 devstack sudo[98058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d550d122-aa24-476a-b115-6182c0fd5305 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 Jul 06 21:16:55 devstack sudo[98058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:56 devstack sudo[98058]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d550d122-aa24-476a-b115-6182c0fd5305 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437" returned: 0 in 0.735s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:56 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 is being set with open permissions: ugo+rw Jul 06 21:16:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:56 devstack sudo[98070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 Jul 06 21:16:56 devstack sudo[98070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:57 devstack sudo[98070]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437" returned: 0 in 0.807s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:57 devstack sudo[98114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.info Jul 06 21:16:57 devstack sudo[98114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:58 devstack sudo[98114]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.info" returned: 0 in 0.697s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:58 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.info is being set with open permissions: ugo+rw Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:58 devstack sudo[98122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.info Jul 06 21:16:58 devstack sudo[98122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:58 devstack sudo[98122]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.info" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.747s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.609s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:16:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1462640274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51923e26-8c78-43b8-aec6-4ea19299702f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d144d60af2e473abee6c1a50d24b027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:16:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:16:55Z,use_quota=True,user_id='8023c0761be04501aef8dee0b19d0096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Creating volume 51923e26-8c78-43b8-aec6-4ea19299702f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:16:58 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:16:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:58 devstack sudo[98147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f 1073741824 Jul 06 21:16:58 devstack sudo[98147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:16:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d88c0410-2a9e-4e67-8ea1-a76d1b0de650 tempest-TestStampPattern-1850900608 None] Create snapshot completed successfully Jul 06 21:16:59 devstack sudo[98147]: pam_unix(sudo:session): session closed for user root Jul 06 21:16:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f 1073741824" returned: 0 in 0.938s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:16:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:16:59 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f Jul 06 21:16:59 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:00 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f" returned: 0 in 0.927s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] <== create_volume: return (1922ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:17:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.927s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5e4132a-ab13-4357-8ff2-5573dabf5e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51923e26-8c78-43b8-aec6-4ea19299702f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc915ffc-97a6-4ec7-b7cb-038b255a12cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:00 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Volume volume-51923e26-8c78-43b8-aec6-4ea19299702f (51923e26-8c78-43b8-aec6-4ea19299702f): created successfully Jul 06 21:17:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc915ffc-97a6-4ec7-b7cb-038b255a12cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Flow 'volume_create_manager' (eb06d8fe-a7d8-4d6b-bb84-b2a41e8bf29d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a92803d0-d6d3-48a4-bb71-bbc06c21c695 tempest-VolumesTransfersV357Test-518491083 None] Created volume successfully. Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:01 devstack sudo[98158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:17:01 devstack sudo[98158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:01 devstack sudo[98158]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.817s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 8 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:17:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:17:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-020cfba6-5202-40c5-97b6-c1913c19b7cb tempest-VolumesTransfersV357Test-562718347 None] Transfer volume completed successfully. Jul 06 21:17:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Acquiring lock "cinder-51923e26-8c78-43b8-aec6-4ea19299702f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-51923e26-8c78-43b8-aec6-4ea19299702f-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Acquiring lock "cinder-quobyte-51923e26-8c78-43b8-aec6-4ea19299702f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-quobyte-51923e26-8c78-43b8-aec6-4ea19299702f" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:03 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[af5cff05-1014-4d6f-9ee6-616eb6fddbb7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:03 devstack sudo[98166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f Jul 06 21:17:03 devstack sudo[98166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:04 devstack sudo[98166]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f" returned: 0 in 0.894s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:04 devstack sudo[98200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f Jul 06 21:17:04 devstack sudo[98200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:05 devstack sudo[98200]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-51923e26-8c78-43b8-aec6-4ea19299702f" returned: 0 in 0.700s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-quobyte-51923e26-8c78-43b8-aec6-4ea19299702f" released by "delete_volume" :: held 1.653s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Created reservations ['4c54f94e-6c96-4e56-8ce5-aae0a0bc79d5', '57d9f3a9-031d-483e-b342-63b9aad9e7c4', 'ab7103d3-2c81-40ac-b765-e4980e47614c', 'c89d22ad-1276-4e89-bd25-c1d7b986d503'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:05 devstack sudo[98212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:17:05 devstack sudo[98212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:05 devstack sudo[98212]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.706s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:05 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:17:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Deleted volume successfully. Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2fa98f5c-918a-4fa5-89a3-11032d0e57e0 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-51923e26-8c78-43b8-aec6-4ea19299702f-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Flow 'volume_create_manager' (ceb361a5-d186-4c54-8db0-1485301b51e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af19eea4-3c6e-412c-9fd5-aa050186b31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (af19eea4-3c6e-412c-9fd5-aa050186b31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1634241121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58db676c-4774-425d-81aa-c728bea60efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d144d60af2e473abee6c1a50d24b027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:06Z,use_quota=True,user_id='8023c0761be04501aef8dee0b19d0096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f1b8b9-60a3-4d62-b726-fc22d05ae75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f1b8b9-60a3-4d62-b726-fc22d05ae75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdb4c4e-0f64-47b2-8799-8f34d634c801) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abdb4c4e-0f64-47b2-8799-8f34d634c801) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58db676c-4774-425d-81aa-c728bea60efa', 'volume_name': 'volume-58db676c-4774-425d-81aa-c728bea60efa', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45080960-9579-4cd6-a604-90d3c3267c40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45080960-9579-4cd6-a604-90d3c3267c40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794b9d4-8557-4b32-9a61-28ada7b064ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:06 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Volume 58db676c-4774-425d-81aa-c728bea60efa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58db676c-4774-425d-81aa-c728bea60efa', 'volume_size': 1} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1634241121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58db676c-4774-425d-81aa-c728bea60efa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d144d60af2e473abee6c1a50d24b027',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:06Z,use_quota=True,user_id='8023c0761be04501aef8dee0b19d0096',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Creating volume 58db676c-4774-425d-81aa-c728bea60efa {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:17:06 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:17:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:06 devstack sudo[98215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa 1073741824 Jul 06 21:17:06 devstack sudo[98215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:07 devstack sudo[98215]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa 1073741824" returned: 0 in 0.913s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:07 devstack sudo[98221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa Jul 06 21:17:07 devstack sudo[98221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:08 devstack sudo[98221]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] <== create_volume: return (1757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:17:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.760s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3794b9d4-8557-4b32-9a61-28ada7b064ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58db676c-4774-425d-81aa-c728bea60efa', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0433d9-187a-4945-bfb5-4d759a386ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:08 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Volume volume-58db676c-4774-425d-81aa-c728bea60efa (58db676c-4774-425d-81aa-c728bea60efa): created successfully Jul 06 21:17:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d0433d9-187a-4945-bfb5-4d759a386ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Flow 'volume_create_manager' (ceb361a5-d186-4c54-8db0-1485301b51e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5f789093-74c8-4c91-aa00-a9b97bd884db tempest-VolumesTransfersV357Test-518491083 None] Created volume successfully. Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Flow 'volume_create_manager' (bf11e5b3-257e-4ff9-94f9-dcbf41df8248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3517cb90-dafa-4112-90e0-417e785c1921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3517cb90-dafa-4112-90e0-417e785c1921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1409919641',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d701fd00-9d13-45ca-876e-1cd439231f37,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ff4ae41ffd94fd18b938e9950770c8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c8b7852f-213d-4b96-bf2a-9a934aaa4437,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:10Z,use_quota=True,user_id='89315444bc2740a985a588486ec7ca64',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60adb92-6d58-4a24-bea7-0fe084fa01d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60adb92-6d58-4a24-bea7-0fe084fa01d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a34c462-9732-46df-aa58-2aa2f4bf1ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a34c462-9732-46df-aa58-2aa2f4bf1ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'd701fd00-9d13-45ca-876e-1cd439231f37', 'volume_name': 'volume-d701fd00-9d13-45ca-876e-1cd439231f37', 'volume_size': 1, 'snapshot_id': 'c8b7852f-213d-4b96-bf2a-9a934aaa4437'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64191d18-bfcd-48cb-840f-e5ba7056e84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64191d18-bfcd-48cb-840f-e5ba7056e84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9907f2f-7393-47ce-b844-7749f9556170) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:09 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Volume d701fd00-9d13-45ca-876e-1cd439231f37: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-d701fd00-9d13-45ca-876e-1cd439231f37', 'volume_size': 1, 'snapshot_id': 'c8b7852f-213d-4b96-bf2a-9a934aaa4437'} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-quobyte-c8b7852f-213d-4b96-bf2a-9a934aaa4437-d701fd00-9d13-45ca-876e-1cd439231f37" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-c8b7852f-213d-4b96-bf2a-9a934aaa4437-d701fd00-9d13-45ca-876e-1cd439231f37" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Creating volume d701fd00-9d13-45ca-876e-1cd439231f37 from snapshot c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-quobyte-d701fd00-9d13-45ca-876e-1cd439231f37" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d701fd00-9d13-45ca-876e-1cd439231f37" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] snapshot: c8b7852f-213d-4b96-bf2a-9a934aaa4437, volume: d701fd00-9d13-45ca-876e-1cd439231f37, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Acquiring lock "cinder-58db676c-4774-425d-81aa-c728bea60efa-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a59e84-373c-4dae-8a8a-b3cff0935d6b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-58db676c-4774-425d-81aa-c728bea60efa-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Acquiring lock "cinder-quobyte-58db676c-4774-425d-81aa-c728bea60efa" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-quobyte-58db676c-4774-425d-81aa-c728bea60efa" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1a0edba-908f-4a7c-bb2c-ad98044888ee]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:10 devstack sudo[98225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 Jul 06 21:17:10 devstack sudo[98225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:10 devstack sudo[98226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa Jul 06 21:17:10 devstack sudo[98226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:10 devstack sudo[98225]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437" returned: 0 in 0.990s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d550d122-aa24-476a-b115-6182c0fd5305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[36ae7aed-8644-4d4f-b9f2-9acd5947a60f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:11 devstack sudo[98237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:17:11 devstack sudo[98237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:11 devstack sudo[98226]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa" returned: 0 in 1.028s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:11 devstack sudo[98240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa Jul 06 21:17:11 devstack sudo[98240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:11 devstack sudo[98237]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 0.985s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:11 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:17:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:11 devstack sudo[98240]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-58db676c-4774-425d-81aa-c728bea60efa" returned: 0 in 0.817s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-quobyte-58db676c-4774-425d-81aa-c728bea60efa" released by "delete_volume" :: held 1.907s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:11 devstack sudo[98265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 Jul 06 21:17:11 devstack sudo[98265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Created reservations ['28aa94cb-1732-4ab1-bb02-9ec329f2d62e', '20aa231c-334d-4e5c-9d8f-5e78022ed1bd', 'b40b14ab-5573-4f1a-a356-020210ff35da', '505bf2fd-7835-436e-b415-691313ee2bca'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:12 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:17:12 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:12 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.740s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:17:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Deleted volume successfully. Jul 06 21:17:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-986adccd-15bf-49d1-a935-28d753254a65 tempest-VolumesTransfersV357Test-465388036 None] Lock "cinder-58db676c-4774-425d-81aa-c728bea60efa-delete_volume" released by "delete_volume" :: held 2.960s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:18 devstack sudo[98265]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37" returned: 0 in 6.280s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[656595bf-aa01-4436-b0b7-5ca62bf50390]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:18 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:17:18 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:19 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 1.627s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:19 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305, size 1024.00 MB, duration 6.28 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:17:19 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Converted 1024.00 MB image at 163.04 MB/s Jul 06 21:17:19 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 is being set with open permissions: ugo+rw Jul 06 21:17:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:19 devstack sudo[98287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 Jul 06 21:17:19 devstack sudo[98287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:20 devstack sudo[98287]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37" returned: 0 in 0.984s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d701fd00-9d13-45ca-876e-1cd439231f37" released by "_copy_volume_from_snapshot" :: held 11.026s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-c8b7852f-213d-4b96-bf2a-9a934aaa4437-d701fd00-9d13-45ca-876e-1cd439231f37" released by "_create_volume_from_snapshot" :: held 11.077s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.103s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9907f2f-7393-47ce-b844-7749f9556170) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d701fd00-9d13-45ca-876e-1cd439231f37', 'volume_size': 1, 'snapshot_id': 'c8b7852f-213d-4b96-bf2a-9a934aaa4437'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105b625e-833c-43a7-aa1e-fc92053e7c8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:21 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Volume volume-d701fd00-9d13-45ca-876e-1cd439231f37 (d701fd00-9d13-45ca-876e-1cd439231f37): created successfully Jul 06 21:17:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105b625e-833c-43a7-aa1e-fc92053e7c8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Flow 'volume_create_manager' (bf11e5b3-257e-4ff9-94f9-dcbf41df8248) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0c4172ab-5071-4626-b4ea-feaabe30c904 tempest-TestStampPattern-1850900608 None] Created volume successfully. Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Flow 'volume_create_manager' (04c8d7a1-9d06-4697-80d5-4771a9885125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291bded3-cd6b-4b94-ad06-8f71517d392c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (291bded3-cd6b-4b94-ad06-8f71517d392c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2129234451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d2b258-4304-44ef-bb42-9207dde436d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e99f08e6ca4c66b3cff6569b6625b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:23Z,use_quota=True,user_id='a5b48a62f002459ab3f6aaa32d0a4e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ec2275-7d7d-4aee-b3d7-2029ba009c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (92ec2275-7d7d-4aee-b3d7-2029ba009c59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfe4786-c47a-4cc0-8c60-14f90111b1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Flow 'volume_create_manager' (0e9183e7-e861-43ff-b58d-b72ff46e6b03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bd81d5-af1e-4371-95c3-2856112fe9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c4bd81d5-af1e-4371-95c3-2856112fe9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-176422296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5991539-c554-4f8f-bdfd-04d7e972a20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a763f1ce68f40438e64355a1ae557a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:23Z,use_quota=True,user_id='6a83bc17d8594769b5eca213836d63d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14be2f36-29a0-43da-a539-36313aa47d6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14be2f36-29a0-43da-a539-36313aa47d6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee6dd3-1d76-4d1b-804b-defe7e707b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8aee6dd3-1d76-4d1b-804b-defe7e707b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f5991539-c554-4f8f-bdfd-04d7e972a20f', 'volume_name': 'volume-f5991539-c554-4f8f-bdfd-04d7e972a20f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f873cdc8-db0f-44ef-a291-bebecbf40711) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f873cdc8-db0f-44ef-a291-bebecbf40711) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcec8248-68b6-438e-9d0a-6abf2492fbd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Volume f5991539-c554-4f8f-bdfd-04d7e972a20f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f5991539-c554-4f8f-bdfd-04d7e972a20f', 'volume_size': 1} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-176422296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f5991539-c554-4f8f-bdfd-04d7e972a20f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a763f1ce68f40438e64355a1ae557a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:23Z,use_quota=True,user_id='6a83bc17d8594769b5eca213836d63d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Creating volume f5991539-c554-4f8f-bdfd-04d7e972a20f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:17:23 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:23 devstack sudo[98316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f 1073741824 Jul 06 21:17:23 devstack sudo[98316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ddfe4786-c47a-4cc0-8c60-14f90111b1d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86d2b258-4304-44ef-bb42-9207dde436d7', 'volume_name': 'volume-86d2b258-4304-44ef-bb42-9207dde436d7', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1709685-7c05-4bb9-956b-6a470fdf4dd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1709685-7c05-4bb9-956b-6a470fdf4dd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85950b2-8902-4754-967f-42ebb22fa4b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Volume 86d2b258-4304-44ef-bb42-9207dde436d7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86d2b258-4304-44ef-bb42-9207dde436d7', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 21:17:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Trying to clone 86d2b258-4304-44ef-bb42-9207dde436d7 from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:17:24 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:17:24 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Image download 20.69 MB at 20.69 MB/s Jul 06 21:17:24 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3ed6a8-d65d-4060-abb1-7d369b620fa3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:24 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD Jul 06 21:17:24 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:24 devstack sudo[98316]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f 1073741824" returned: 0 in 1.224s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:24 devstack sudo[98365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f Jul 06 21:17:24 devstack sudo[98365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:25 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD" returned: 0 in 0.783s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f is fetched for user a5b48a62f002459ab3f6aaa32d0a4e20. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc1ca07-05e3-4a4f-b8fc-6b78a53748ec]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:25 devstack sudo[98365]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] <== create_volume: return (1959ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.965s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcec8248-68b6-438e-9d0a-6abf2492fbd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f5991539-c554-4f8f-bdfd-04d7e972a20f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64d2232-fb5b-462f-9d27-33b38de4a5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:25 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Volume volume-f5991539-c554-4f8f-bdfd-04d7e972a20f (f5991539-c554-4f8f-bdfd-04d7e972a20f): created successfully Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a64d2232-fb5b-462f-9d27-33b38de4a5ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Flow 'volume_create_manager' (0e9183e7-e861-43ff-b58d-b72ff46e6b03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f3f7e10a-17e5-4604-8fe4-f60ef4a3d3df tempest-AttachVolumeNegativeTest-429805347 None] Created volume successfully. Jul 06 21:17:25 devstack sudo[98380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD Jul 06 21:17:25 devstack sudo[98380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:26 devstack sudo[98380]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD" returned: 0 in 0.762s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-2129234451',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86d2b258-4304-44ef-bb42-9207dde436d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e99f08e6ca4c66b3cff6569b6625b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:23Z,use_quota=True,user_id='a5b48a62f002459ab3f6aaa32d0a4e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Creating volume 86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:17:26 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:17:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:26 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 1073741824 Jul 06 21:17:26 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:27 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 1073741824" returned: 0 in 0.949s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:27 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:27 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:27 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 0 in 0.717s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.710s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Attempting download of 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 86d2b258-4304-44ef-bb42-9207dde436d7. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca3e0291-840b-42ba-a7e0-0973525587bc]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_rcvrno08 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:28 devstack sudo[98410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_rcvrno08 Jul 06 21:17:28 devstack sudo[98410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:28 devstack sudo[98410]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_rcvrno08" returned: 0 in 0.831s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_rcvrno08 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:28 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_rcvrno08 Jul 06 21:17:28 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:29 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_rcvrno08" returned: 1 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_rcvrno08' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ac9bfcb-eea8-4969-bb9c-22a8a7c50b1e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:29 devstack sudo[98419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD Jul 06 21:17:29 devstack sudo[98419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fb1a46c1-b599-417e-86c1-88a769e574dc req-cad9eb83-7005-49da-949f-85daeb9df29b tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fb1a46c1-b599-417e-86c1-88a769e574dc req-cad9eb83-7005-49da-949f-85daeb9df29b tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee3fa275-9462-4737-833c-2511096c8b40]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-fb1a46c1-b599-417e-86c1-88a769e574dc req-cad9eb83-7005-49da-949f-85daeb9df29b tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:30 devstack sudo[98429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f Jul 06 21:17:30 devstack sudo[98429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:30 devstack sudo[98419]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD" returned: 0 in 0.898s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:30 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f was qcow2, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:17:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:30 devstack sudo[98436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:30 devstack sudo[98436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:30 devstack sudo[98429]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-fb1a46c1-b599-417e-86c1-88a769e574dc req-cad9eb83-7005-49da-949f-85daeb9df29b tempest-AttachVolumeNegativeTest-429805347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f" returned: 0 in 1.019s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-fb1a46c1-b599-417e-86c1-88a769e574dc req-cad9eb83-7005-49da-949f-85daeb9df29b tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.043s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-fb1a46c1-b599-417e-86c1-88a769e574dc req-cad9eb83-7005-49da-949f-85daeb9df29b tempest-AttachVolumeNegativeTest-429805347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-f5991539-c554-4f8f-bdfd-04d7e972a20f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '23c520dc-8fed-4a07-9500-5722f0ed8f5f', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:17:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-fb1a46c1-b599-417e-86c1-88a769e574dc req-cad9eb83-7005-49da-949f-85daeb9df29b tempest-AttachVolumeNegativeTest-429805347 None] attachment_update completed successfully. Jul 06 21:17:32 devstack sudo[98436]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 0 in 2.202s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:32 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_uotz7nt3devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:17:32 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Converted 112.00 MB image at 50.85 MB/s Jul 06 21:17:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:32 devstack sudo[98830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 1G Jul 06 21:17:32 devstack sudo[98830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:33 devstack sudo[98830]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 1G" returned: 0 in 0.707s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:33 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddc3a769-9066-46c5-9be9-efa09a1b1055]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:33 devstack sudo[98835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:33 devstack sudo[98835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:34 devstack sudo[98835]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 0 in 0.762s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:34 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:34 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:35 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 1 in 0.778s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Downloaded image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 86d2b258-4304-44ef-bb42-9207dde436d7 successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f for user a5b48a62f002459ab3f6aaa32d0a4e20 is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Marking volume 86d2b258-4304-44ef-bb42-9207dde436d7 as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Copying metadata from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f to 86d2b258-4304-44ef-bb42-9207dde436d7. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Creating volume glance metadata for volume 86d2b258-4304-44ef-bb42-9207dde436d7 backed by image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f85950b2-8902-4754-967f-42ebb22fa4b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86d2b258-4304-44ef-bb42-9207dde436d7', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097ea206-d3bd-4a09-8877-757292400d02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Volume volume-86d2b258-4304-44ef-bb42-9207dde436d7 (86d2b258-4304-44ef-bb42-9207dde436d7): created successfully Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (097ea206-d3bd-4a09-8877-757292400d02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Flow 'volume_create_manager' (04c8d7a1-9d06-4697-80d5-4771a9885125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-57b23f25-a9bb-40f2-9042-13311fba6a68 tempest-VolumesExtendTest-581102158 None] Created volume successfully. Jul 06 21:17:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c2a5056-1763-4b22-8531-c1d517c1d0ee]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:36 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:36 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:37 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 0 in 0.808s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:37 devstack sudo[98850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:37 devstack sudo[98850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:37 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-5205fc4e-7263-449f-9194-3ea1fa82bc95 req-ea6dba65-65e0-485d-9c3f-71166743412e tempest-AttachVolumeNegativeTest-429805347 None] Terminate volume connection completed successfully. Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-5205fc4e-7263-449f-9194-3ea1fa82bc95 req-ea6dba65-65e0-485d-9c3f-71166743412e tempest-AttachVolumeNegativeTest-429805347 None] Deleting attachment 23c520dc-8fed-4a07-9500-5722f0ed8f5f. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:17:37 devstack sudo[98850]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 1 in 0.833s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 2G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 2G" returned: 0 in 0.057s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.759s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0a2eb4ce-6224-4ee3-8a46-f4508e78cb17 tempest-VolumesExtendTest-581102158 None] Extend volume completed successfully. Jul 06 21:17:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Acquiring lock "cinder-86d2b258-4304-44ef-bb42-9207dde436d7-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Lock "cinder-86d2b258-4304-44ef-bb42-9207dde436d7-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Acquiring lock "cinder-quobyte-86d2b258-4304-44ef-bb42-9207dde436d7" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-86d2b258-4304-44ef-bb42-9207dde436d7" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2414e870-d7d1-4476-ad3e-f101ef71b241]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:38 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:38 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:39 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:39 devstack sudo[98902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:39 devstack sudo[98902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:40 devstack sudo[98902]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 1 in 0.744s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:17:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:40 devstack sudo[98907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7 Jul 06 21:17:40 devstack sudo[98907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:40 devstack sudo[98907]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-86d2b258-4304-44ef-bb42-9207dde436d7" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-86d2b258-4304-44ef-bb42-9207dde436d7" released by "delete_volume" :: held 2.228s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:40 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=65,cinder:UPDATE=60,cinder:DELETE=6,cinder:INSERT=17 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:17:40 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=65,cinder:SELECT=63,cinder:INSERT=21,cinder:DELETE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Created reservations ['01a855b0-620f-4677-9ce7-d3ac94759d66', '2327f740-5c2c-4d7b-8fbb-5bb0e8a547b3', '5d1540b6-1af9-4836-8838-49eb77fd712d', 'cb329e6f-82ea-4791-a292-60c1d73dd019'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:41 devstack sudo[98915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:17:41 devstack sudo[98915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:41 devstack sudo[98915]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.737s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:17:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Deleted volume successfully. Jul 06 21:17:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-736d7ca1-5aff-4f53-a13b-88ebdb00530a tempest-VolumesExtendTest-581102158 None] Lock "cinder-86d2b258-4304-44ef-bb42-9207dde436d7-delete_volume" released by "delete_volume" :: held 3.197s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Flow 'volume_create_manager' (043883f4-72b5-47e6-a65c-8f207e151d59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cddd012-2aa8-4232-901b-47d109d1ead8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cddd012-2aa8-4232-901b-47d109d1ead8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1343913986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0eccc4-92c2-4e71-945f-bc5ddbf81904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e99f08e6ca4c66b3cff6569b6625b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:42Z,use_quota=True,user_id='a5b48a62f002459ab3f6aaa32d0a4e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c1e3e6-32f1-44e7-ab29-2b3ebee046ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (69c1e3e6-32f1-44e7-ab29-2b3ebee046ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560b14ef-8a28-4909-8598-eee1ad88b1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (560b14ef-8a28-4909-8598-eee1ad88b1cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5d0eccc4-92c2-4e71-945f-bc5ddbf81904', 'volume_name': 'volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce6312a-1058-47ab-b87d-896298a4789e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ce6312a-1058-47ab-b87d-896298a4789e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fd5df5-0a5c-4072-98bb-5d720a8b22cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:42 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Volume 5d0eccc4-92c2-4e71-945f-bc5ddbf81904: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904', 'volume_size': 1} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:17:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1343913986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5d0eccc4-92c2-4e71-945f-bc5ddbf81904,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='81e99f08e6ca4c66b3cff6569b6625b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:17:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:17:42Z,use_quota=True,user_id='a5b48a62f002459ab3f6aaa32d0a4e20',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Creating volume 5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:17:42 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:17:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:42 devstack sudo[98936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 1073741824 Jul 06 21:17:42 devstack sudo[98936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:43 devstack sudo[98936]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 1073741824" returned: 0 in 0.876s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:43 devstack sudo[98944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 Jul 06 21:17:43 devstack sudo[98944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:44 devstack sudo[98944]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] <== create_volume: return (1625ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.628s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16fd5df5-0a5c-4072-98bb-5d720a8b22cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321c00ea-3b0d-452c-ac15-a9691798a2ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:17:44 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Volume volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 (5d0eccc4-92c2-4e71-945f-bc5ddbf81904): created successfully Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (321c00ea-3b0d-452c-ac15-a9691798a2ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Flow 'volume_create_manager' (043883f4-72b5-47e6-a65c-8f207e151d59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:17:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1ed24a99-2c1f-46c1-a064-1ae87f74304d tempest-VolumesExtendTest-581102158 None] Created volume successfully. Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Creating offline snapshot 38e6244f-4fa8-4ab9-93fd-f7005515fa12 of volume 5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ffd1cd6-d32f-491e-871d-f284a6d00c55]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:44 devstack sudo[98948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 Jul 06 21:17:44 devstack sudo[98948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:45 devstack sudo[98948]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" returned: 0 in 0.804s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:45 devstack sudo[98963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 1G Jul 06 21:17:45 devstack sudo[98963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:46 devstack sudo[98963]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 1G" returned: 0 in 0.805s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:46 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 Jul 06 21:17:46 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:47 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12" returned: 0 in 0.772s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:47 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 is being set with open permissions: ugo+rw Jul 06 21:17:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:47 devstack sudo[99012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 Jul 06 21:17:47 devstack sudo[99012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:47 devstack sudo[99012]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:47 devstack sudo[99017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.info Jul 06 21:17:47 devstack sudo[99017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:48 devstack sudo[99017]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.info" returned: 0 in 0.687s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:48 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.info is being set with open permissions: ugo+rw Jul 06 21:17:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:48 devstack sudo[99021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.info Jul 06 21:17:48 devstack sudo[99021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:49 devstack sudo[99021]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.info" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.550s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-fff39f0f-837b-4e2c-8d70-c173aafdb1dd tempest-VolumesExtendTest-581102158 None] Create snapshot completed successfully Jul 06 21:17:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:50 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b775cd51-d661-41c5-a0d1-4d619517d33a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:50 devstack sudo[99024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 Jul 06 21:17:50 devstack sudo[99024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:50 devstack sudo[99024]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" returned: 0 in 0.861s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 2G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 2G" returned: 0 in 0.139s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.038s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7ff39037-e3cb-4661-b2d5-7eb13990b9f4 tempest-VolumesExtendTest-581102158 None] Extend volume completed successfully. Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Acquiring lock "cinder-38e6244f-4fa8-4ab9-93fd-f7005515fa12-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Lock "cinder-38e6244f-4fa8-4ab9-93fd-f7005515fa12-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Acquiring lock "cinder-quobyte-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Acquiring lock "cinder-quobyte-38e6244f-4fa8-4ab9-93fd-f7005515fa12" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-38e6244f-4fa8-4ab9-93fd-f7005515fa12" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Deleting offline snapshot 38e6244f-4fa8-4ab9-93fd-f7005515fa12 of volume 5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] snapshot_file for this snap is: volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d65602e1-6bd0-4297-9ef6-5e59d7de41e4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:52 devstack sudo[99036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 Jul 06 21:17:52 devstack sudo[99036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:53 devstack sudo[99036]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:17:53 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[88574e5c-bc36-4bc1-8dcd-a098d7891d73]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:53 devstack sudo[99041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 Jul 06 21:17:53 devstack sudo[99041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:54 devstack sudo[99041]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" returned: 0 in 0.777s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:54 devstack sudo[99046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 Jul 06 21:17:54 devstack sudo[99046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:54 devstack sudo[99046]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12" returned: 0 in 0.752s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:54 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12 Jul 06 21:17:54 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:55 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904.38e6244f-4fa8-4ab9-93fd-f7005515fa12" returned: 0 in 0.682s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-38e6244f-4fa8-4ab9-93fd-f7005515fa12" released by "_delete_snapshot" :: held 3.116s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" released by "delete_snapshot" :: held 3.142s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:55 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Created reservations ['ed5db325-5590-4cbc-aada-bc5b1812185e', 'fc747199-0d21-4e4c-99eb-a8cfc885115b', '44c50e77-26ae-412c-aa1c-1a5775ef4982', '0d50a122-78f9-4ff4-8c80-0ad339ecfa90'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:17:55 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Delete snapshot completed successfully. Jul 06 21:17:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f8adff62-95ed-4658-b669-8215f9c2ce20 tempest-VolumesExtendTest-581102158 None] Lock "cinder-38e6244f-4fa8-4ab9-93fd-f7005515fa12-delete_snapshot" released by "delete_snapshot" :: held 3.281s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Acquiring lock "cinder-5d0eccc4-92c2-4e71-945f-bc5ddbf81904-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Lock "cinder-5d0eccc4-92c2-4e71-945f-bc5ddbf81904-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Acquiring lock "cinder-quobyte-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:17:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:17:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a531785-c8cc-4e51-813f-e0ec4c95147e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:17:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:56 devstack sudo[99062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 Jul 06 21:17:56 devstack sudo[99062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:57 devstack sudo[99062]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" returned: 0 in 0.860s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:57 devstack sudo[99079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904 Jul 06 21:17:57 devstack sudo[99079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:58 devstack sudo[99079]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" returned: 0 in 0.681s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Lock "cinder-quobyte-5d0eccc4-92c2-4e71-945f-bc5ddbf81904" released by "delete_volume" :: held 1.600s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Created reservations ['e1871122-77a4-43f5-83cf-50f7c50f0515', '03705612-7620-45f6-b9ce-c0403f68dc87', '8d995480-6616-4ad3-9ecc-9b49b07d8257', 'ed72cd78-cab3-42e9-af22-4a11e4a6aa2b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:17:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:17:58 devstack sudo[99089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:17:58 devstack sudo[99089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:17:59 devstack sudo[99089]: pam_unix(sudo:session): session closed for user root Jul 06 21:17:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.687s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:17:59 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:17:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Deleted volume successfully. Jul 06 21:17:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e1eb0f23-41c0-4f14-aa34-efda06cf512a tempest-VolumesExtendTest-581102158 None] Lock "cinder-5d0eccc4-92c2-4e71-945f-bc5ddbf81904-delete_volume" released by "delete_volume" :: held 2.508s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:01 devstack sudo[99132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:01 devstack sudo[99132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:01 devstack sudo[99132]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.744s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:18:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (ddab448e-34cd-48b7-8d58-378aeeb49970) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021e3a34-348d-4c5f-9ac1-d0d78524c832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021e3a34-348d-4c5f-9ac1-d0d78524c832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-431216025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c296db80-1d5a-4247-ab29-a418e4673309,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:02Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e338f85-4581-4c12-a6d3-2efad6728e7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7e338f85-4581-4c12-a6d3-2efad6728e7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde627bc-f0da-4f85-b68d-250e63832d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fde627bc-f0da-4f85-b68d-250e63832d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c296db80-1d5a-4247-ab29-a418e4673309', 'volume_name': 'volume-c296db80-1d5a-4247-ab29-a418e4673309', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cfd833-1acb-45d5-a8fd-2c0b01bb0fc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0cfd833-1acb-45d5-a8fd-2c0b01bb0fc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c6e5bb-4393-48d4-8571-d89352bdad55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Volume c296db80-1d5a-4247-ab29-a418e4673309: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c296db80-1d5a-4247-ab29-a418e4673309', 'volume_size': 1} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-431216025',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c296db80-1d5a-4247-ab29-a418e4673309,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:02Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Creating volume c296db80-1d5a-4247-ab29-a418e4673309 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:02 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:02 devstack sudo[99144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 1073741824 Jul 06 21:18:02 devstack sudo[99144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:02 devstack sudo[99144]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 1073741824" returned: 0 in 0.862s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:03 devstack sudo[99169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 Jul 06 21:18:03 devstack sudo[99169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:03 devstack sudo[99169]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309" returned: 0 in 0.687s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] <== create_volume: return (1610ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.613s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06c6e5bb-4393-48d4-8571-d89352bdad55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c296db80-1d5a-4247-ab29-a418e4673309', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089744c4-b37a-4709-8390-220991d059cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Volume volume-c296db80-1d5a-4247-ab29-a418e4673309 (c296db80-1d5a-4247-ab29-a418e4673309): created successfully Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (089744c4-b37a-4709-8390-220991d059cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (ddab448e-34cd-48b7-8d58-378aeeb49970) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-acb37810-86f7-4520-be2b-cae20694db61 tempest-VolumesGetTest-523041334 None] Created volume successfully. Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (4524a50d-79b1-4691-9a88-85a0b02d760b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cafeb8-d6e7-48f6-8b0b-e6b0245bb549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (48cafeb8-d6e7-48f6-8b0b-e6b0245bb549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-987620441',display_name='tempest-VolumesGetTest-Volume-740463644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925a866f-dddd-47c5-9fb6-f510df3b31a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:05Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693781a6-41ae-4894-a357-247351737ea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (693781a6-41ae-4894-a357-247351737ea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6648198f-9f49-4339-9525-3a48fe3677df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6648198f-9f49-4339-9525-3a48fe3677df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '925a866f-dddd-47c5-9fb6-f510df3b31a2', 'volume_name': 'volume-925a866f-dddd-47c5-9fb6-f510df3b31a2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f0c3f0-1b0c-49ac-826c-d3580b3eabd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (46f0c3f0-1b0c-49ac-826c-d3580b3eabd1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3e52c9-98d2-4bc5-9c0e-0cc647a3dd74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:05 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Volume 925a866f-dddd-47c5-9fb6-f510df3b31a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-925a866f-dddd-47c5-9fb6-f510df3b31a2', 'volume_size': 1} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:05Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-987620441',display_name='tempest-VolumesGetTest-Volume-740463644',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=925a866f-dddd-47c5-9fb6-f510df3b31a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:05Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Creating volume 925a866f-dddd-47c5-9fb6-f510df3b31a2 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:05 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:05 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 1073741824 Jul 06 21:18:05 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:06 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 1073741824" returned: 0 in 0.984s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:06 devstack sudo[99180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 Jul 06 21:18:06 devstack sudo[99180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:06 devstack sudo[99180]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2" returned: 0 in 0.737s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] <== create_volume: return (1779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.784s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ad3e52c9-98d2-4bc5-9c0e-0cc647a3dd74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-925a866f-dddd-47c5-9fb6-f510df3b31a2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded00748-eb8e-4a6c-af25-8e1193ee6b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:06 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Volume volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 (925a866f-dddd-47c5-9fb6-f510df3b31a2): created successfully Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ded00748-eb8e-4a6c-af25-8e1193ee6b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (4524a50d-79b1-4691-9a88-85a0b02d760b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-94e74028-3a69-4869-8835-b50681308a88 tempest-VolumesGetTest-523041334 None] Created volume successfully. Jul 06 21:18:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-925a866f-dddd-47c5-9fb6-f510df3b31a2-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Lock "cinder-925a866f-dddd-47c5-9fb6-f510df3b31a2-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-925a866f-dddd-47c5-9fb6-f510df3b31a2" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-925a866f-dddd-47c5-9fb6-f510df3b31a2" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:07 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a279601e-9493-4413-994f-593a2433bf1b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:07 devstack sudo[99192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 Jul 06 21:18:07 devstack sudo[99192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:08 devstack sudo[99192]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2" returned: 0 in 0.773s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:08 devstack sudo[99198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2 Jul 06 21:18:08 devstack sudo[99198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:08 devstack sudo[99198]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-925a866f-dddd-47c5-9fb6-f510df3b31a2" returned: 0 in 0.638s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-925a866f-dddd-47c5-9fb6-f510df3b31a2" released by "delete_volume" :: held 1.460s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Created reservations ['eed4e9a3-eeaf-4ffd-a03c-4ddb0b45c9ef', '1a22d77c-dcf6-4d1d-9f12-0e892cdd375f', 'e46a7a36-77fa-4442-9acc-ce968bfe499a', '73b00956-4a2d-4992-80bf-eae1648ede23'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:08 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:08 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-c296db80-1d5a-4247-ab29-a418e4673309-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:09 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.763s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Lock "cinder-c296db80-1d5a-4247-ab29-a418e4673309-delete_volume" acquired by "delete_volume" :: waited 0.091s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Deleted volume successfully. Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f445189b-2b1b-4301-9866-c1cb1f0fa37a tempest-VolumesGetTest-523041334 None] Lock "cinder-925a866f-dddd-47c5-9fb6-f510df3b31a2-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-c296db80-1d5a-4247-ab29-a418e4673309" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-c296db80-1d5a-4247-ab29-a418e4673309" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0f6c58e-c1f2-41c0-b4d7-3e57bbcc130a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:09 devstack sudo[99205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 Jul 06 21:18:09 devstack sudo[99205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-6158e538-b0bf-4682-b7d6-0a41881df5be req-89db1675-82b9-4655-9aaf-2df8d4de7e8c tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-6158e538-b0bf-4682-b7d6-0a41881df5be req-89db1675-82b9-4655-9aaf-2df8d4de7e8c tempest-TestStampPattern-1850900608 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb215903-6125-47a9-a703-676a3e2b8467]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-6158e538-b0bf-4682-b7d6-0a41881df5be req-89db1675-82b9-4655-9aaf-2df8d4de7e8c tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:10 devstack sudo[99215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 Jul 06 21:18:10 devstack sudo[99215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:10 devstack sudo[99205]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309" returned: 0 in 0.804s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:10 devstack sudo[99220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309 Jul 06 21:18:10 devstack sudo[99220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:11 devstack sudo[99215]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-6158e538-b0bf-4682-b7d6-0a41881df5be req-89db1675-82b9-4655-9aaf-2df8d4de7e8c tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37" returned: 0 in 0.844s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-6158e538-b0bf-4682-b7d6-0a41881df5be req-89db1675-82b9-4655-9aaf-2df8d4de7e8c tempest-TestStampPattern-1850900608 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.862s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-6158e538-b0bf-4682-b7d6-0a41881df5be req-89db1675-82b9-4655-9aaf-2df8d4de7e8c tempest-TestStampPattern-1850900608 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-d701fd00-9d13-45ca-876e-1cd439231f37', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ffa60987-956e-4239-a36e-07d945712198', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:18:11 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-6158e538-b0bf-4682-b7d6-0a41881df5be req-89db1675-82b9-4655-9aaf-2df8d4de7e8c tempest-TestStampPattern-1850900608 None] attachment_update completed successfully. Jul 06 21:18:11 devstack sudo[99220]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c296db80-1d5a-4247-ab29-a418e4673309" returned: 0 in 0.767s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-c296db80-1d5a-4247-ab29-a418e4673309" released by "delete_volume" :: held 1.621s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Created reservations ['68eae41d-aa30-42e5-bb2c-6b7fbc58046c', 'dc9be136-6aa1-4fa8-858b-2b86fe0481ce', 'e4e8ee52-6e21-4394-b86f-4eacce3d340e', '3a6943c7-9246-495d-b7ab-b08432f9458b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:11 devstack sudo[99293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:11 devstack sudo[99293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:12 devstack sudo[99293]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.758s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Deleted volume successfully. Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-781ccdc8-a984-48a4-8792-1fe916249a61 tempest-VolumesGetTest-523041334 None] Lock "cinder-c296db80-1d5a-4247-ab29-a418e4673309-delete_volume" released by "delete_volume" :: held 2.672s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (2c2868c0-7fbc-4efa-ae8f-fc3f820a9fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58736742-2d43-47aa-a228-a2e13cb28406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58736742-2d43-47aa-a228-a2e13cb28406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1542131701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bff283c-036b-45ea-b31e-c25b560d16ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:12Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cd39d3-8804-44ad-95ba-53ab25516721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cd39d3-8804-44ad-95ba-53ab25516721) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a01e43-0eba-4b0e-bd5b-0c61e01e66b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7a01e43-0eba-4b0e-bd5b-0c61e01e66b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bff283c-036b-45ea-b31e-c25b560d16ab', 'volume_name': 'volume-6bff283c-036b-45ea-b31e-c25b560d16ab', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01d0a10-8d66-4a8b-91d2-95123efcf77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f01d0a10-8d66-4a8b-91d2-95123efcf77d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1307870-e2c8-40a5-aebb-4f4acf9d9d24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Volume 6bff283c-036b-45ea-b31e-c25b560d16ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bff283c-036b-45ea-b31e-c25b560d16ab', 'volume_size': 1} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1542131701',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bff283c-036b-45ea-b31e-c25b560d16ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:12Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Creating volume 6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:12 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:12 devstack sudo[99612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab 1073741824 Jul 06 21:18:12 devstack sudo[99612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:13 devstack sudo[99612]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab 1073741824" returned: 0 in 0.825s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:13 devstack sudo[99618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab Jul 06 21:18:13 devstack sudo[99618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:14 devstack sudo[99618]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab" returned: 0 in 0.686s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] <== create_volume: return (1574ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:18:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1307870-e2c8-40a5-aebb-4f4acf9d9d24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bff283c-036b-45ea-b31e-c25b560d16ab', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25b8dba-d46e-43f0-914b-08ff344b31ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:14 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Volume volume-6bff283c-036b-45ea-b31e-c25b560d16ab (6bff283c-036b-45ea-b31e-c25b560d16ab): created successfully Jul 06 21:18:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c25b8dba-d46e-43f0-914b-08ff344b31ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (2c2868c0-7fbc-4efa-ae8f-fc3f820a9fad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-147662b5-449c-48f4-bd95-a08b5505ca52 tempest-VolumesGetTest-523041334 None] Created volume successfully. Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (99b32ba7-305e-41ec-8c89-d69bbc711242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0746ee25-6560-4aa3-b529-2353df14054b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0746ee25-6560-4aa3-b529-2353df14054b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1743208807',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=283cc771-4bef-48f8-b291-b43bc0723558,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=6bff283c-036b-45ea-b31e-c25b560d16ab,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:15Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f0b69a-45fc-4849-b745-865d8e7077ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5f0b69a-45fc-4849-b745-865d8e7077ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bf3e71-5b5d-4504-b78c-379ec72f7ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09bf3e71-5b5d-4504-b78c-379ec72f7ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '283cc771-4bef-48f8-b291-b43bc0723558', 'volume_name': 'volume-283cc771-4bef-48f8-b291-b43bc0723558', 'volume_size': 1, 'source_volid': '6bff283c-036b-45ea-b31e-c25b560d16ab', 'source_volstatus': 'available'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8c9090-0cf0-4a4a-aa40-edbd3558644b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c8c9090-0cf0-4a4a-aa40-edbd3558644b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2a0adb-7be2-4d81-b693-5ba8d13fcf44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:15 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Volume 283cc771-4bef-48f8-b291-b43bc0723558: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-283cc771-4bef-48f8-b291-b43bc0723558', 'volume_size': 1, 'source_volid': '6bff283c-036b-45ea-b31e-c25b560d16ab', 'source_volstatus': 'available'} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:15 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Cloning volume 6bff283c-036b-45ea-b31e-c25b560d16ab to volume 283cc771-4bef-48f8-b291-b43bc0723558 Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Creating offline snapshot 0622d525-87cc-4c3c-a013-7f2831939ef3 of volume 6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a59c3ecd-6ad9-4fe3-8834-4335741fccd3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:15 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab Jul 06 21:18:15 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:16 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab" returned: 0 in 0.823s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:16 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 1G Jul 06 21:18:16 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:16 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 1G" returned: 0 in 0.813s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bff283c-036b-45ea-b31e-c25b560d16ab -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:16 devstack sudo[99665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bff283c-036b-45ea-b31e-c25b560d16ab -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 Jul 06 21:18:16 devstack sudo[99665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:17 devstack sudo[99665]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6bff283c-036b-45ea-b31e-c25b560d16ab -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3" returned: 0 in 0.704s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:17 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 is being set with open permissions: ugo+rw Jul 06 21:18:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:17 devstack sudo[99671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 Jul 06 21:18:17 devstack sudo[99671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-3a260d57-a6f1-4d81-9f28-1c6f5501b7c2 req-41a1b28b-36f1-453b-b393-bdaa00ddd4fd tempest-TestStampPattern-1850900608 None] Terminate volume connection completed successfully. Jul 06 21:18:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-3a260d57-a6f1-4d81-9f28-1c6f5501b7c2 req-41a1b28b-36f1-453b-b393-bdaa00ddd4fd tempest-TestStampPattern-1850900608 None] Deleting attachment ffa60987-956e-4239-a36e-07d945712198. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:18:18 devstack sudo[99671]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:18 devstack sudo[99701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.info Jul 06 21:18:18 devstack sudo[99701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:18 devstack sudo[99701]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.info" returned: 0 in 0.646s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:18 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.info is being set with open permissions: ugo+rw Jul 06 21:18:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:18 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.info Jul 06 21:18:18 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:19 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.info" returned: 0 in 0.650s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-283cc771-4bef-48f8-b291-b43bc0723558" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-283cc771-4bef-48f8-b291-b43bc0723558" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] snapshot: 0622d525-87cc-4c3c-a013-7f2831939ef3, volume: 283cc771-4bef-48f8-b291-b43bc0723558, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b110bdce-1033-4ff1-9de6-8fb14fcb52e6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:19 devstack sudo[99708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 Jul 06 21:18:19 devstack sudo[99708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:20 devstack sudo[99708]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3" returned: 0 in 0.866s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bff283c-036b-45ea-b31e-c25b560d16ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:18:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:18:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:18:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1ed1505-e61b-4540-b633-8e47e9b56ccb]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:20 devstack sudo[99715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab Jul 06 21:18:20 devstack sudo[99715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:21 devstack sudo[99715]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab" returned: 0 in 0.857s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:21 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:18:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:21 devstack sudo[99721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 Jul 06 21:18:21 devstack sudo[99721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:27 devstack sudo[99721]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558" returned: 0 in 5.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cdaa05c2-831c-429c-92e8-46a4e2994b7b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:27 devstack sudo[99763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab Jul 06 21:18:27 devstack sudo[99763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Flow 'volume_create_manager' (ee61cba7-0ac5-4a5a-ab47-3f94d2fc1ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3eb51c-2adc-410f-9a8a-9f88d808d8cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd3eb51c-2adc-410f-9a8a-9f88d808d8cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-270050153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacdfc81-3ffa-4c66-87c2-865af2729b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a763f1ce68f40438e64355a1ae557a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:27Z,use_quota=True,user_id='6a83bc17d8594769b5eca213836d63d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218976d1-7968-4050-88f0-26146b397568) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (218976d1-7968-4050-88f0-26146b397568) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac3cd97-8d8a-45e8-82c9-fecdaa0e2b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ac3cd97-8d8a-45e8-82c9-fecdaa0e2b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cacdfc81-3ffa-4c66-87c2-865af2729b07', 'volume_name': 'volume-cacdfc81-3ffa-4c66-87c2-865af2729b07', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fd5571-8f31-4662-a641-8d7c412b3656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75fd5571-8f31-4662-a641-8d7c412b3656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0e1e7b-1034-4598-b1dd-d277475c7600) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:27 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Volume cacdfc81-3ffa-4c66-87c2-865af2729b07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cacdfc81-3ffa-4c66-87c2-865af2729b07', 'volume_size': 1} Jul 06 21:18:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:28 devstack sudo[99763]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab" returned: 0 in 0.929s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab, size 1024.00 MB, duration 5.67 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:18:28 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Converted 1024.00 MB image at 180.52 MB/s Jul 06 21:18:28 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 is being set with open permissions: ugo+rw Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:28 devstack sudo[99768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 Jul 06 21:18:28 devstack sudo[99768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:28 devstack sudo[99768]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558" returned: 0 in 0.649s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-283cc771-4bef-48f8-b291-b43bc0723558" released by "_copy_volume_from_snapshot" :: held 9.049s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-0622d525-87cc-4c3c-a013-7f2831939ef3" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-0622d525-87cc-4c3c-a013-7f2831939ef3" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Deleting offline snapshot 0622d525-87cc-4c3c-a013-7f2831939ef3 of volume 6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] snapshot_file for this snap is: volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[818724bd-8be3-4f68-a82b-94c52d0c1cbf]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:28 devstack sudo[99772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 Jul 06 21:18:28 devstack sudo[99772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-d701fd00-9d13-45ca-876e-1cd439231f37-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Lock "cinder-d701fd00-9d13-45ca-876e-1cd439231f37-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-quobyte-d701fd00-9d13-45ca-876e-1cd439231f37" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d701fd00-9d13-45ca-876e-1cd439231f37" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[19c205bd-603d-4ed7-bccf-a81adf63bd33]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:29 devstack sudo[99774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 Jul 06 21:18:29 devstack sudo[99774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:29 devstack sudo[99772]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3" returned: 0 in 0.790s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6bff283c-036b-45ea-b31e-c25b560d16ab(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:18:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[13188b96-9dd4-4a92-b754-7c7f115b26e6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:29 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab Jul 06 21:18:29 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:29 devstack sudo[99774]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:29 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37 Jul 06 21:18:29 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:30 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:30 devstack sudo[99789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 Jul 06 21:18:30 devstack sudo[99789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:30 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d701fd00-9d13-45ca-876e-1cd439231f37" returned: 0 in 0.665s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d701fd00-9d13-45ca-876e-1cd439231f37" released by "delete_volume" :: held 1.485s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Created reservations ['7cf46b54-3f47-4564-b552-259f2a1aae43', '6e015ab5-ae94-47d6-9365-279131317834', '96fb72bc-ec61-426d-8477-97c698e1eefa', '0bc3c685-a894-4037-b4f2-b88d81107547'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:30 devstack sudo[99792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:30 devstack sudo[99792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:31 devstack sudo[99789]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3" returned: 0 in 0.742s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:31 devstack sudo[99797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3 Jul 06 21:18:31 devstack sudo[99797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:31 devstack sudo[99792]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.696s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Deleted volume successfully. Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6364a4a2-35cc-4bfc-9db5-4dd6ea79525a tempest-TestStampPattern-1850900608 None] Lock "cinder-d701fd00-9d13-45ca-876e-1cd439231f37-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-c8b7852f-213d-4b96-bf2a-9a934aaa4437-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Lock "cinder-c8b7852f-213d-4b96-bf2a-9a934aaa4437-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-quobyte-d550d122-aa24-476a-b115-6182c0fd5305" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d550d122-aa24-476a-b115-6182c0fd5305" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-quobyte-c8b7852f-213d-4b96-bf2a-9a934aaa4437" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-c8b7852f-213d-4b96-bf2a-9a934aaa4437" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Deleting offline snapshot c8b7852f-213d-4b96-bf2a-9a934aaa4437 of volume d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] snapshot_file for this snap is: volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[20460dd4-c759-44f8-a3cb-a556aef4a7a0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:31 devstack sudo[99800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 Jul 06 21:18:31 devstack sudo[99800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:31 devstack sudo[99797]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab.0622d525-87cc-4c3c-a013-7f2831939ef3" returned: 0 in 0.722s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-0622d525-87cc-4c3c-a013-7f2831939ef3" released by "_delete_snapshot" :: held 3.096s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.635s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.374s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-270050153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cacdfc81-3ffa-4c66-87c2-865af2729b07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6a763f1ce68f40438e64355a1ae557a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:27Z,use_quota=True,user_id='6a83bc17d8594769b5eca213836d63d5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Creating volume cacdfc81-3ffa-4c66-87c2-865af2729b07 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:31 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a2a0adb-7be2-4d81-b693-5ba8d13fcf44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-283cc771-4bef-48f8-b291-b43bc0723558', 'volume_size': 1, 'source_volid': '6bff283c-036b-45ea-b31e-c25b560d16ab', 'source_volstatus': 'available'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:31 devstack sudo[99803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 1073741824 Jul 06 21:18:31 devstack sudo[99803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf68392-0296-4c37-99cb-bd5e2d0c21bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:31 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Volume volume-283cc771-4bef-48f8-b291-b43bc0723558 (283cc771-4bef-48f8-b291-b43bc0723558): created successfully Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aaf68392-0296-4c37-99cb-bd5e2d0c21bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (99b32ba7-305e-41ec-8c89-d69bbc711242) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a047d493-51a5-4df8-a798-3b82c219b24c tempest-VolumesGetTest-523041334 None] Created volume successfully. Jul 06 21:18:32 devstack sudo[99800]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437" returned: 0 in 0.764s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d550d122-aa24-476a-b115-6182c0fd5305(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:18:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[05cee09a-4ec8-4ea2-a8eb-cb63c7722fcb]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:32 devstack sudo[99808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:18:32 devstack sudo[99808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:32 devstack sudo[99803]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 1073741824" returned: 0 in 0.936s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:32 devstack sudo[99814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 Jul 06 21:18:32 devstack sudo[99814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (dc411d92-1a75-48f0-b518-c8ceb570098a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f581db-a31e-4fac-bb87-158e9c62dcfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f581db-a31e-4fac-bb87-158e9c62dcfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1045117916',display_name='tempest-VolumesGetTest-Volume-121143717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428915ab-0b6d-4842-b43f-1b937d5b4d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:33Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7406545-25c7-46a5-9a1f-55d8b258794f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7406545-25c7-46a5-9a1f-55d8b258794f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:33 devstack sudo[99808]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9015edf-e616-476c-905a-519ad94a2c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9015edf-e616-476c-905a-519ad94a2c0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '428915ab-0b6d-4842-b43f-1b937d5b4d4e', 'volume_name': 'volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a5a6c4-721c-437f-bba2-0188c4bd88f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67a5a6c4-721c-437f-bba2-0188c4bd88f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e94b90-6a75-42f3-9e66-55dbc2c3203a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:33 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Volume 428915ab-0b6d-4842-b43f-1b937d5b4d4e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e', 'volume_size': 1} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 0.865s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:33 devstack sudo[99819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 Jul 06 21:18:33 devstack sudo[99819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:33 devstack sudo[99814]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07" returned: 0 in 0.695s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] <== create_volume: return (1682ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.695s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.361s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1045117916',display_name='tempest-VolumesGetTest-Volume-121143717',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=428915ab-0b6d-4842-b43f-1b937d5b4d4e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:33Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Creating volume 428915ab-0b6d-4842-b43f-1b937d5b4d4e {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:33 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:33 devstack sudo[99822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e 1073741824 Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ee0e1e7b-1034-4598-b1dd-d277475c7600) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cacdfc81-3ffa-4c66-87c2-865af2729b07', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:33 devstack sudo[99822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bb6efc-b1c0-4360-999b-fc64169a55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:33 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Volume volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 (cacdfc81-3ffa-4c66-87c2-865af2729b07): created successfully Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27bb6efc-b1c0-4360-999b-fc64169a55dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Flow 'volume_create_manager' (ee61cba7-0ac5-4a5a-ab47-3f94d2fc1ee8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:33 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d88834aa-f2ee-409d-b893-31c8149f31f3 tempest-AttachVolumeNegativeTest-429805347 None] Created volume successfully. Jul 06 21:18:33 devstack sudo[99819]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:34 devstack sudo[99830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437 Jul 06 21:18:34 devstack sudo[99830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:34 devstack sudo[99822]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e 1073741824" returned: 0 in 0.860s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:34 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e Jul 06 21:18:34 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:34 devstack sudo[99830]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305.c8b7852f-213d-4b96-bf2a-9a934aaa4437" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-c8b7852f-213d-4b96-bf2a-9a934aaa4437" released by "_delete_snapshot" :: held 3.221s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d550d122-aa24-476a-b115-6182c0fd5305" released by "delete_snapshot" :: held 3.244s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:34 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Created reservations ['8d34bf70-94ac-467d-baff-09621778e082', 'c44f3da6-3959-4794-9ce2-988ecd5ea498', '4146519e-1629-43b1-b095-94d97ded456d', '7ea646e9-a64b-47e6-9076-1bd6986dc2b8'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Delete snapshot completed successfully. Jul 06 21:18:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-df1c4ee2-fc49-4b2e-96e6-84953fddabd1 tempest-TestStampPattern-1850900608 None] Lock "cinder-c8b7852f-213d-4b96-bf2a-9a934aaa4437-delete_snapshot" released by "delete_snapshot" :: held 3.394s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:35 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e" returned: 0 in 0.672s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:18:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.585s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (47e94b90-6a75-42f3-9e66-55dbc2c3203a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6f53a0-116c-4d49-9040-ab187eee7ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Volume volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e (428915ab-0b6d-4842-b43f-1b937d5b4d4e): created successfully Jul 06 21:18:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc6f53a0-116c-4d49-9040-ab187eee7ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (dc411d92-1a75-48f0-b518-c8ceb570098a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4dae5929-ac2c-45b4-874c-69fa65b690ef tempest-VolumesGetTest-523041334 None] Created volume successfully. Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-428915ab-0b6d-4842-b43f-1b937d5b4d4e-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Lock "cinder-428915ab-0b6d-4842-b43f-1b937d5b4d4e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-428915ab-0b6d-4842-b43f-1b937d5b4d4e" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-428915ab-0b6d-4842-b43f-1b937d5b4d4e" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ac29966-dc1e-4416-abbe-3a85a5d974ec]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:36 devstack sudo[99841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e Jul 06 21:18:36 devstack sudo[99841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-8f186001-8d4b-4529-aee9-9971d27da302 req-fb74b0bc-dcc6-472d-acc4-c399ce361d33 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-8f186001-8d4b-4529-aee9-9971d27da302 req-fb74b0bc-dcc6-472d-acc4-c399ce361d33 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7492dccf-50e3-4ad7-a6ee-6fe3e0499154]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-8f186001-8d4b-4529-aee9-9971d27da302 req-fb74b0bc-dcc6-472d-acc4-c399ce361d33 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:36 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 Jul 06 21:18:36 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:37 devstack sudo[99841]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:37 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e Jul 06 21:18:37 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:37 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-8f186001-8d4b-4529-aee9-9971d27da302 req-fb74b0bc-dcc6-472d-acc4-c399ce361d33 tempest-AttachVolumeNegativeTest-429805347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07" returned: 0 in 0.878s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-8f186001-8d4b-4529-aee9-9971d27da302 req-fb74b0bc-dcc6-472d-acc4-c399ce361d33 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.901s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:37 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-8f186001-8d4b-4529-aee9-9971d27da302 req-fb74b0bc-dcc6-472d-acc4-c399ce361d33 tempest-AttachVolumeNegativeTest-429805347 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-cacdfc81-3ffa-4c66-87c2-865af2729b07', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5b59c0de-a0ae-46b0-9fce-7ace7c52f86a', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:18:37 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-8f186001-8d4b-4529-aee9-9971d27da302 req-fb74b0bc-dcc6-472d-acc4-c399ce361d33 tempest-AttachVolumeNegativeTest-429805347 None] attachment_update completed successfully. Jul 06 21:18:38 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-428915ab-0b6d-4842-b43f-1b937d5b4d4e" returned: 0 in 0.711s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-428915ab-0b6d-4842-b43f-1b937d5b4d4e" released by "delete_volume" :: held 1.576s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Created reservations ['6e3be8a5-e8a4-4a17-bd77-c21b47433671', '5188fc05-1169-4adc-ba4e-7f1f33d05a9d', '61211a5e-fbcb-4e90-b22f-5a6b9099ecf1', 'b2b4f4ff-e206-46b2-94bf-dd2e697d521b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:38 devstack sudo[99870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:38 devstack sudo[99870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-283cc771-4bef-48f8-b291-b43bc0723558-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Lock "cinder-283cc771-4bef-48f8-b291-b43bc0723558-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-283cc771-4bef-48f8-b291-b43bc0723558" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-283cc771-4bef-48f8-b291-b43bc0723558" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6d8876f-ecfe-41e6-b091-ff2d4a95651b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:39 devstack sudo[99954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 Jul 06 21:18:39 devstack sudo[99954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:39 devstack sudo[99870]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.943s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:39 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Deleted volume successfully. Jul 06 21:18:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-68465182-3485-4956-bb5a-2bf10ce734bf tempest-VolumesGetTest-523041334 None] Lock "cinder-428915ab-0b6d-4842-b43f-1b937d5b4d4e-delete_volume" released by "delete_volume" :: held 2.735s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:39 devstack sudo[99954]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558" returned: 0 in 0.963s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:39 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558 Jul 06 21:18:39 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:40 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-283cc771-4bef-48f8-b291-b43bc0723558" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-283cc771-4bef-48f8-b291-b43bc0723558" released by "delete_volume" :: held 1.662s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Created reservations ['f25a6e3f-3407-4bfb-a8bd-9a43ab81e208', '07861847-a95f-4670-9f2e-4d34929a96e2', '81fac169-9934-466b-a32a-d514debc9413', '24a46df8-64f0-4ec9-b5f3-197907739836'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:40 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:40 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-6bff283c-036b-45ea-b31e-c25b560d16ab-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Lock "cinder-6bff283c-036b-45ea-b31e-c25b560d16ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=82,cinder:INSERT=25,cinder:UPDATE=95,cinder:DELETE=8 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:INSERT=21,cinder:UPDATE=98,cinder:SELECT=75,cinder:DELETE=6 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-6bff283c-036b-45ea-b31e-c25b560d16ab" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-6bff283c-036b-45ea-b31e-c25b560d16ab" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebb7f4dd-c534-47c4-822a-5c3cb35ef2d1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:41 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.672s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Deleted volume successfully. Jul 06 21:18:41 devstack sudo[100285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab Jul 06 21:18:41 devstack sudo[100285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9980b75f-99cd-4f07-b873-8d3233713677 tempest-VolumesGetTest-523041334 None] Lock "cinder-283cc771-4bef-48f8-b291-b43bc0723558-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:42 devstack sudo[100285]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab" returned: 0 in 0.798s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:42 devstack sudo[100290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab Jul 06 21:18:42 devstack sudo[100290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:42 devstack sudo[100290]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6bff283c-036b-45ea-b31e-c25b560d16ab" returned: 0 in 0.662s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-6bff283c-036b-45ea-b31e-c25b560d16ab" released by "delete_volume" :: held 1.525s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Created reservations ['57888fb9-9933-4802-ad6a-9c1b69b9777c', '48af94bc-7f16-46eb-92b7-340c0e9a503b', 'aee0e2fb-ba13-4a45-a29c-47d42b3b06f0', 'e532e915-6561-4253-8aab-4dc5f505c1c7'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:42 devstack sudo[100293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:42 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:43 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:43 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Deleted volume successfully. Jul 06 21:18:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f5ec47f6-0db4-493f-9111-3cdfe559503a tempest-VolumesGetTest-523041334 None] Lock "cinder-6bff283c-036b-45ea-b31e-c25b560d16ab-delete_volume" released by "delete_volume" :: held 2.427s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-d550d122-aa24-476a-b115-6182c0fd5305-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Lock "cinder-d550d122-aa24-476a-b115-6182c0fd5305-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (87e13645-d873-4761-a2fd-648b7d65e764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892eeb0c-2466-4304-bdd0-937764c23663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Acquiring lock "cinder-quobyte-d550d122-aa24-476a-b115-6182c0fd5305" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (892eeb0c-2466-4304-bdd0-937764c23663) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-890507624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac5fc85-d3cf-4221-9027-c5095b4bddca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:44Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ad19a7-83d8-4e5e-95ca-2cd2576540e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ad19a7-83d8-4e5e-95ca-2cd2576540e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1a2e00-c5cb-444d-918e-541d54a1a989) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d550d122-aa24-476a-b115-6182c0fd5305" acquired by "delete_volume" :: waited 0.043s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7c45674-0567-4fcd-9812-45ae75910b61]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:44 devstack sudo[100296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:18:44 devstack sudo[100296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d1a2e00-c5cb-444d-918e-541d54a1a989) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6ac5fc85-d3cf-4221-9027-c5095b4bddca', 'volume_name': 'volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4522f9-be47-4030-8b2f-01503013f98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df4522f9-be47-4030-8b2f-01503013f98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963a7065-3229-4e95-a908-334e1fb9e7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:44 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Volume 6ac5fc85-d3cf-4221-9027-c5095b4bddca: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Trying to clone 6ac5fc85-d3cf-4221-9027-c5095b4bddca from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:18:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-a2e9ec2e-f3c8-4884-aa2f-e73050360a95 req-7ae0b5f8-8cb0-4844-a43c-8357bcc12efc tempest-AttachVolumeNegativeTest-429805347 None] Terminate volume connection completed successfully. Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-a2e9ec2e-f3c8-4884-aa2f-e73050360a95 req-7ae0b5f8-8cb0-4844-a43c-8357bcc12efc tempest-AttachVolumeNegativeTest-429805347 None] Deleting attachment 5b59c0de-a0ae-46b0-9fce-7ace7c52f86a. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:18:44 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Image download 20.69 MB at 20.69 MB/s Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[93a57baf-e030-452c-9bda-5a29630a1e64]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:45 devstack sudo[100296]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 0.844s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:45 devstack sudo[100329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD Jul 06 21:18:45 devstack sudo[100329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:45 devstack sudo[100331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305 Jul 06 21:18:45 devstack sudo[100331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:45 devstack sudo[100331]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d550d122-aa24-476a-b115-6182c0fd5305" returned: 0 in 0.644s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:45 devstack sudo[100329]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f is fetched for user b3dbdecfe7784aa78c00b19ab671270c. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Lock "cinder-quobyte-d550d122-aa24-476a-b115-6182c0fd5305" released by "delete_volume" :: held 1.542s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Created reservations ['07dbab05-a0f5-4463-a6af-651499f14890', '7e70a3e7-54bd-459b-b050-0dfeca092447', '7dc45105-64fa-4f06-b7c9-ff00aec2a1c9', 'e1f81397-a29f-406c-ae03-3ede92945ee0'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2599201-194e-4fd2-b61e-b58444d4c6a6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:45 devstack sudo[100338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:45 devstack sudo[100338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:45 devstack sudo[100337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD Jul 06 21:18:45 devstack sudo[100337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:46 devstack sudo[100338]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.694s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Deleted volume successfully. Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98c94b6a-ee18-484d-b137-a30964312ceb tempest-TestStampPattern-1850900608 None] Lock "cinder-d550d122-aa24-476a-b115-6182c0fd5305-delete_volume" released by "delete_volume" :: held 2.530s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:46 devstack sudo[100337]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD" returned: 0 in 0.820s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-890507624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ac5fc85-d3cf-4221-9027-c5095b4bddca,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:44Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Creating volume 6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:46 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:46 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca 1073741824 Jul 06 21:18:46 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:47 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca 1073741824" returned: 0 in 1.079s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:47 devstack sudo[100393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca Jul 06 21:18:47 devstack sudo[100393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:48 devstack sudo[100393]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca" returned: 0 in 0.696s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] <== create_volume: return (1854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:18:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.861s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:48 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Attempting download of 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 6ac5fc85-d3cf-4221-9027-c5095b4bddca. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:18:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8f4d5a5f-93f6-42df-8ffa-537ca1f2cd97]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_b870mlcd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:48 devstack sudo[100405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_b870mlcd Jul 06 21:18:48 devstack sudo[100405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:49 devstack sudo[100405]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_b870mlcd" returned: 0 in 0.918s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_b870mlcd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:49 devstack sudo[100426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_b870mlcd Jul 06 21:18:49 devstack sudo[100426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:50 devstack sudo[100426]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_b870mlcd" returned: 1 in 0.832s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_b870mlcd' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:18:50 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4250d80d-4f84-4e9b-8c8e-3669e5e75f66]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:50 devstack sudo[100431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD Jul 06 21:18:50 devstack sudo[100431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:51 devstack sudo[100431]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD" returned: 0 in 0.847s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:51 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f was qcow2, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:18:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:51 devstack sudo[100439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca Jul 06 21:18:51 devstack sudo[100439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:53 devstack sudo[100439]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca" returned: 0 in 2.018s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:53 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_kgkdpj4jdevstack@QuobyteHD, size 112.00 MB, duration 2.02 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:18:53 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Converted 112.00 MB image at 55.44 MB/s Jul 06 21:18:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:53 devstack sudo[100452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca 1G Jul 06 21:18:53 devstack sudo[100452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:53 devstack sudo[100452]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca 1G" returned: 0 in 0.837s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f57ecf18-3b80-4bfd-9bed-4f6b29bddf77]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:54 devstack sudo[100457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca Jul 06 21:18:54 devstack sudo[100457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:54 devstack sudo[100457]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca" returned: 0 in 0.885s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:55 devstack sudo[100462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca Jul 06 21:18:55 devstack sudo[100462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "cinder-cacdfc81-3ffa-4c66-87c2-865af2729b07-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-cacdfc81-3ffa-4c66-87c2-865af2729b07-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "cinder-quobyte-cacdfc81-3ffa-4c66-87c2-865af2729b07" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-quobyte-cacdfc81-3ffa-4c66-87c2-865af2729b07" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[df5bcd25-bf46-40f2-a4ca-0241ba6c71b0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:55 devstack sudo[100464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 Jul 06 21:18:55 devstack sudo[100464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:55 devstack sudo[100462]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca" returned: 1 in 0.882s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Downloaded image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 6ac5fc85-d3cf-4221-9027-c5095b4bddca successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f for user b3dbdecfe7784aa78c00b19ab671270c is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Marking volume 6ac5fc85-d3cf-4221-9027-c5095b4bddca as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Copying metadata from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f to 6ac5fc85-d3cf-4221-9027-c5095b4bddca. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Creating volume glance metadata for volume 6ac5fc85-d3cf-4221-9027-c5095b4bddca backed by image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (963a7065-3229-4e95-a908-334e1fb9e7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ad60dd-8ea0-472a-8c4e-f75fd7f7629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:55 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Volume volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca (6ac5fc85-d3cf-4221-9027-c5095b4bddca): created successfully Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54ad60dd-8ea0-472a-8c4e-f75fd7f7629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (87e13645-d873-4761-a2fd-648b7d65e764) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4521965a-cc39-4c44-9b98-2752b7b8c991 tempest-VolumesGetTest-523041334 None] Created volume successfully. Jul 06 21:18:56 devstack sudo[100464]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07" returned: 0 in 0.831s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:56 devstack sudo[100473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07 Jul 06 21:18:56 devstack sudo[100473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:56 devstack sudo[100473]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-cacdfc81-3ffa-4c66-87c2-865af2729b07" returned: 0 in 0.688s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-quobyte-cacdfc81-3ffa-4c66-87c2-865af2729b07" released by "delete_volume" :: held 1.582s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Created reservations ['ea6efe4a-e4ed-4781-9093-908f06ae9517', 'e2fd0baa-5aca-4cb1-8e85-055c787d52a8', '9d84e307-b732-45c8-b1f0-30f58ed13b00', '605bf6f7-c5a2-40f8-b124-7a5640cfe601'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:56 devstack sudo[100482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:56 devstack sudo[100482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "cinder-f5991539-c554-4f8f-bdfd-04d7e972a20f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-f5991539-c554-4f8f-bdfd-04d7e972a20f-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "cinder-quobyte-f5991539-c554-4f8f-bdfd-04d7e972a20f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-quobyte-f5991539-c554-4f8f-bdfd-04d7e972a20f" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[fed86897-caf2-428e-a254-be51e73b9098]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:57 devstack sudo[100482]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.844s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:18:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Deleted volume successfully. Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (b7552291-0e38-44ea-8d05-e5302b85e4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0664a28-eecf-4c8c-acaf-13d21edc724e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6d2e94c4-d7ed-40f9-9a35-3e4e7e102b1e tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-cacdfc81-3ffa-4c66-87c2-865af2729b07-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:57 devstack sudo[100485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f Jul 06 21:18:57 devstack sudo[100485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f0664a28-eecf-4c8c-acaf-13d21edc724e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-40774247',display_name='tempest-VolumesGetTest-Volume-22415493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acea1ecc-446c-41e8-aac1-fe71ff951a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:58Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b8363a-2d6d-4481-99a9-1232b82cf33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04b8363a-2d6d-4481-99a9-1232b82cf33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e37744-e004-4c99-b58d-ec01907797b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (65e37744-e004-4c99-b58d-ec01907797b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'acea1ecc-446c-41e8-aac1-fe71ff951a54', 'volume_name': 'volume-acea1ecc-446c-41e8-aac1-fe71ff951a54', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9e9322-4c5e-4555-8260-bfd1bf8dd39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c9e9322-4c5e-4555-8260-bfd1bf8dd39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9862243-2786-4cd4-83c9-b899c76f84c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Volume acea1ecc-446c-41e8-aac1-fe71ff951a54: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-acea1ecc-446c-41e8-aac1-fe71ff951a54', 'volume_size': 1} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:57Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-40774247',display_name='tempest-VolumesGetTest-Volume-22415493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=acea1ecc-446c-41e8-aac1-fe71ff951a54,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eb3f8a0a8e384b2eba3f18e9792ac264',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:58Z,use_quota=True,user_id='b3dbdecfe7784aa78c00b19ab671270c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Creating volume acea1ecc-446c-41e8-aac1-fe71ff951a54 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:57 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:57 devstack sudo[100487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 1073741824 Jul 06 21:18:57 devstack sudo[100487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (13d8798d-2ae4-41b3-a6c1-58191076b72f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4356e9-3cd7-49fb-ba41-43de2ac7b223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e4356e9-3cd7-49fb-ba41-43de2ac7b223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797071307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8f877d-7b7e-4885-b19c-ac62cf24b3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:58Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5749d659-303e-4ef9-b0b2-b05d17b5e226) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5749d659-303e-4ef9-b0b2-b05d17b5e226) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfba36c-f045-4ac2-83d2-a2cd97860b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6cfba36c-f045-4ac2-83d2-a2cd97860b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8f8f877d-7b7e-4885-b19c-ac62cf24b3f4', 'volume_name': 'volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266ac439-298f-4a8a-8d5a-6ca6cecec363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:58 devstack sudo[100485]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (266ac439-298f-4a8a-8d5a-6ca6cecec363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0521ed-c458-4382-bc7a-d460e85370ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:58 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Volume 8f8f877d-7b7e-4885-b19c-ac62cf24b3f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4', 'volume_size': 1} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f" returned: 0 in 0.988s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:58 devstack sudo[100499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f Jul 06 21:18:58 devstack sudo[100499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:58 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (0a9e5a45-d45e-4ba3-817d-adc24d73285c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419496c3-5cfe-4729-bb7f-0d6a1c73fc52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack sudo[100487]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 1073741824" returned: 0 in 1.103s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (419496c3-5cfe-4729-bb7f-0d6a1c73fc52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528115543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd3d1e8-a7fb-45b9-ac68-cd0933c29080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:59Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892e332c-3551-4540-bdad-d3e645cd2e2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (892e332c-3551-4540-bdad-d3e645cd2e2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d660a71-19c9-4d65-afa0-326aea5e8f49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d660a71-19c9-4d65-afa0-326aea5e8f49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bd3d1e8-a7fb-45b9-ac68-cd0933c29080', 'volume_name': 'volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3438c73-e8c2-40ae-ba80-99626730b584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a3438c73-e8c2-40ae-ba80-99626730b584) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f39278-d526-4665-92c0-3393d6fa9b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Volume 0bd3d1e8-a7fb-45b9-ac68-cd0933c29080: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080', 'volume_size': 1} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:59 devstack sudo[100502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 Jul 06 21:18:59 devstack sudo[100502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (b35b7651-03f7-4282-9b73-20dbe1dbc895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e762d6b-e434-44be-be0e-3c53f3493561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e762d6b-e434-44be-be0e-3c53f3493561) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018744453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3e6e44-d5ba-40bb-8d65-3211486dacf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:59Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e110e67f-2a8c-4981-8498-753e9373b344) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e110e67f-2a8c-4981-8498-753e9373b344) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d881719-6512-4508-ab1c-2b59ca6f657a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d881719-6512-4508-ab1c-2b59ca6f657a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e3e6e44-d5ba-40bb-8d65-3211486dacf2', 'volume_name': 'volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a431578-f3d6-4fa0-b066-4a74100855e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a431578-f3d6-4fa0-b066-4a74100855e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6002b9c5-da60-4b28-ad46-7fa388d4a58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Volume 4e3e6e44-d5ba-40bb-8d65-3211486dacf2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2', 'volume_size': 1} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:59 devstack sudo[100499]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f5991539-c554-4f8f-bdfd-04d7e972a20f" returned: 0 in 0.801s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-quobyte-f5991539-c554-4f8f-bdfd-04d7e972a20f" released by "delete_volume" :: held 1.854s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Created reservations ['22a31f78-cf6f-4c1d-8d3d-0fc9fcce679c', '9153382d-2b2f-42ab-96eb-21108f857e05', '22a89e47-4a35-4605-a6ad-1eef022e22ef', '469b9d32-13d8-40c7-be88-de10666b7ef1'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:18:59 devstack sudo[100505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:18:59 devstack sudo[100505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (56716506-66e0-4dd0-92e9-17012e94720e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f88d9-c3e1-43c2-be48-5deb105e17cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7f7f88d9-c3e1-43c2-be48-5deb105e17cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1044002135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6435f3-ea91-49c8-aacb-e991bacd9dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:00Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b526b-8ade-434c-a342-ba5bb3d7b8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b9b526b-8ade-434c-a342-ba5bb3d7b8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c1ab57-99a1-4cfb-8fcb-b15795b9b677) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60c1ab57-99a1-4cfb-8fcb-b15795b9b677) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3f6435f3-ea91-49c8-aacb-e991bacd9dce', 'volume_name': 'volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0a300e-1aa7-4517-9264-c5d40a69d9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be0a300e-1aa7-4517-9264-c5d40a69d9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9e5b3e-82c2-42bc-a3ac-406abe458f37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:18:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Volume 3f6435f3-ea91-49c8-aacb-e991bacd9dce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce', 'volume_size': 1} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:59 devstack sudo[100502]: pam_unix(sudo:session): session closed for user root Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54" returned: 0 in 0.859s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] <== create_volume: return (2042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.047s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.237s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-797071307',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8f8f877d-7b7e-4885-b19c-ac62cf24b3f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:58Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Creating volume 8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:18:59 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:18:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:00 devstack sudo[100508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 1073741824 Jul 06 21:19:00 devstack sudo[100508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9862243-2786-4cd4-83c9-b899c76f84c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-acea1ecc-446c-41e8-aac1-fe71ff951a54', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723e7528-1981-4342-aea1-df90ba038f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:00 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Volume volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 (acea1ecc-446c-41e8-aac1-fe71ff951a54): created successfully Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (723e7528-1981-4342-aea1-df90ba038f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Flow 'volume_create_manager' (b7552291-0e38-44ea-8d05-e5302b85e4b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-40455a7c-5322-436f-8179-02376ca83c2d tempest-VolumesGetTest-523041334 None] Created volume successfully. Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "cinder-fe1d3224-a448-4b5d-82dd-74ab79e8f32b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-fe1d3224-a448-4b5d-82dd-74ab79e8f32b-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (28640eb1-bbc5-42cf-a1c3-4ab7234503fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437a5a03-0280-43eb-9d1f-7d468d39580d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (437a5a03-0280-43eb-9d1f-7d468d39580d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852112541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc03de6-5320-4789-ab7d-1fa86a59c733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:00Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066d8382-70a9-45cc-821e-0338bbe8a84b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (066d8382-70a9-45cc-821e-0338bbe8a84b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0f4611-3481-45a8-80c5-fac81d6002a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb0f4611-3481-45a8-80c5-fac81d6002a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'efc03de6-5320-4789-ab7d-1fa86a59c733', 'volume_name': 'volume-efc03de6-5320-4789-ab7d-1fa86a59c733', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d0a219-04ce-434c-8141-8ac651191784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c7d0a219-04ce-434c-8141-8ac651191784) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf202d6d-30dc-407d-81a5-ef362943e957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:00 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Volume efc03de6-5320-4789-ab7d-1fa86a59c733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-efc03de6-5320-4789-ab7d-1fa86a59c733', 'volume_size': 1} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "cinder-quobyte-fe1d3224-a448-4b5d-82dd-74ab79e8f32b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-quobyte-fe1d3224-a448-4b5d-82dd-74ab79e8f32b" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9f4d37-23dd-41f5-8a26-d987a0874ebc]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:00 devstack sudo[100505]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.736s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Deleted volume successfully. Jul 06 21:19:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-9810cf64-622c-4f45-ba20-ea8ea9e90041 tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-f5991539-c554-4f8f-bdfd-04d7e972a20f-delete_volume" released by "delete_volume" :: held 2.876s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:00 devstack sudo[100511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b Jul 06 21:19:00 devstack sudo[100511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:01 devstack sudo[100508]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-acea1ecc-446c-41e8-aac1-fe71ff951a54-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 1073741824" returned: 0 in 1.026s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Lock "cinder-acea1ecc-446c-41e8-aac1-fe71ff951a54-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:01 devstack sudo[100517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 Jul 06 21:19:01 devstack sudo[100517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-acea1ecc-446c-41e8-aac1-fe71ff951a54" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-acea1ecc-446c-41e8-aac1-fe71ff951a54" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf723fce-0193-4dfd-944c-0b0ead1be6ae]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:01 devstack sudo[100522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:01 devstack sudo[100522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:01 devstack sudo[100511]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b" returned: 0 in 0.837s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:01 devstack sudo[100523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 Jul 06 21:19:01 devstack sudo[100523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:01 devstack sudo[100525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b Jul 06 21:19:01 devstack sudo[100525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:01 devstack sudo[100517]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4" returned: 0 in 0.713s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] <== create_volume: return (1803ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.807s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.695s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-528115543',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bd3d1e8-a7fb-45b9-ac68-cd0933c29080,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:59Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Creating volume 0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:01 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0521ed-c458-4382-bc7a-d460e85370ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:01 devstack sudo[100530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 1073741824 Jul 06 21:19:01 devstack sudo[100530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacecbee-e339-4ab6-ad8f-99c1b8f57b22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:01 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Volume volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 (8f8f877d-7b7e-4885-b19c-ac62cf24b3f4): created successfully Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bacecbee-e339-4ab6-ad8f-99c1b8f57b22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (13d8798d-2ae4-41b3-a6c1-58191076b72f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:01 devstack sudo[100522]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.743s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:01 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-36d3b950-ac54-44be-ae0a-805099b494ae tempest-CreateVolumesFromImageTest-540395642 None] Created volume successfully. Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:19:01 devstack sudo[100525]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-fe1d3224-a448-4b5d-82dd-74ab79e8f32b" returned: 0 in 0.719s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-quobyte-fe1d3224-a448-4b5d-82dd-74ab79e8f32b" released by "delete_volume" :: held 1.595s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:02 devstack sudo[100523]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54" returned: 0 in 0.863s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:02 devstack sudo[100536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54 Jul 06 21:19:02 devstack sudo[100536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Created reservations ['72b36fa9-8ee0-4006-be1b-84a2539e0934', 'a5c4ca70-2fc1-445f-89ce-b36acc836c2b', '7bb1b29f-f58a-4f2d-983d-d656f27ce02c', '376db7b6-0d50-4852-8f62-3675cc1dfbd9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:02 devstack sudo[100538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:02 devstack sudo[100538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:02 devstack sudo[100536]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-acea1ecc-446c-41e8-aac1-fe71ff951a54" returned: 0 in 0.694s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:02 devstack sudo[100530]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-acea1ecc-446c-41e8-aac1-fe71ff951a54" released by "delete_volume" :: held 1.621s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 1073741824" returned: 0 in 0.952s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Created reservations ['bb8949c2-1bf3-4410-a25f-4ef9589d7e19', '9a6dbf18-ebff-4eb4-9a0e-f7cdf6622bef', '4f8be879-f22f-438d-b240-be789cbaee3a', '7e4c0908-51b8-4931-9e42-39551cdf66da'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:02 devstack sudo[100547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 Jul 06 21:19:02 devstack sudo[100547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:02 devstack sudo[100538]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.729s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Deleted volume successfully. Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b447bbd-33bf-43e5-98f9-bf78a9fb9efc tempest-AttachVolumeNegativeTest-429805347 None] Lock "cinder-fe1d3224-a448-4b5d-82dd-74ab79e8f32b-delete_volume" released by "delete_volume" :: held 2.691s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:02 devstack sudo[100549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:02 devstack sudo[100549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-6ac5fc85-d3cf-4221-9027-c5095b4bddca-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Lock "cinder-6ac5fc85-d3cf-4221-9027-c5095b4bddca-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Acquiring lock "cinder-quobyte-6ac5fc85-d3cf-4221-9027-c5095b4bddca" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-6ac5fc85-d3cf-4221-9027-c5095b4bddca" acquired by "delete_volume" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:03 devstack sudo[100547]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080" returned: 0 in 0.796s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] <== create_volume: return (1809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.812s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.137s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2018744453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e3e6e44-d5ba-40bb-8d65-3211486dacf2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:18:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:18:59Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Creating volume 4e3e6e44-d5ba-40bb-8d65-3211486dacf2 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:03 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[600de54d-c8ba-452f-86dc-4d568b5a1143]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:03 devstack sudo[100553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 1073741824 Jul 06 21:19:03 devstack sudo[100553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (44f39278-d526-4665-92c0-3393d6fa9b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80eee46d-4612-44a4-ad40-4b3159cf2c5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Volume volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 (0bd3d1e8-a7fb-45b9-ac68-cd0933c29080): created successfully Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80eee46d-4612-44a4-ad40-4b3159cf2c5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (0a9e5a45-d45e-4ba3-817d-adc24d73285c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:03 devstack sudo[100549]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Deleted volume successfully. Jul 06 21:19:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-216305f3-5cbd-455e-907a-5a78bd9cc029 tempest-CreateVolumesFromImageTest-540395642 None] Created volume successfully. Jul 06 21:19:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-52af8eff-64a3-4a35-8be6-94cbf79eb721 tempest-VolumesGetTest-523041334 None] Lock "cinder-acea1ecc-446c-41e8-aac1-fe71ff951a54-delete_volume" released by "delete_volume" :: held 2.726s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:03 devstack sudo[100554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca Jul 06 21:19:03 devstack sudo[100554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:04 devstack sudo[100553]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 1073741824" returned: 0 in 0.952s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:04 devstack sudo[100554]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca" returned: 0 in 0.948s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:04 devstack sudo[100565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 Jul 06 21:19:04 devstack sudo[100565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:04 devstack sudo[100564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca Jul 06 21:19:04 devstack sudo[100564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:05 devstack sudo[100565]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2" returned: 0 in 0.707s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] <== create_volume: return (1743ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.749s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.492s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:18:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1044002135',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3f6435f3-ea91-49c8-aacb-e991bacd9dce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:00Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Creating volume 3f6435f3-ea91-49c8-aacb-e991bacd9dce {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:05 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:05 devstack sudo[100564]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca" returned: 1 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:05 devstack sudo[100572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce 1073741824 Jul 06 21:19:05 devstack sudo[100572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6002b9c5-da60-4b28-ad46-7fa388d4a58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6621405d-f77c-41e9-ba6b-d441dd769130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:05 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca Jul 06 21:19:05 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:05 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Volume volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 (4e3e6e44-d5ba-40bb-8d65-3211486dacf2): created successfully Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6621405d-f77c-41e9-ba6b-d441dd769130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (b35b7651-03f7-4282-9b73-20dbe1dbc895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-eec8f2b7-daf7-418e-81bc-02beaacddf81 tempest-CreateVolumesFromImageTest-540395642 None] Created volume successfully. Jul 06 21:19:06 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6ac5fc85-d3cf-4221-9027-c5095b4bddca" returned: 0 in 0.831s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Lock "cinder-quobyte-6ac5fc85-d3cf-4221-9027-c5095b4bddca" released by "delete_volume" :: held 2.706s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Created reservations ['2d3c747d-5698-4e97-997b-1d2992a7a8e8', '2e2538f4-c071-458e-99a1-1acda5c9a4f0', 'a7c33ec7-1cd1-4037-b113-5bac6884de11', '4996c3e5-612d-47af-a61b-8c0332371f27'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:06 devstack sudo[100572]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce 1073741824" returned: 0 in 0.959s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:06 devstack sudo[100581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce Jul 06 21:19:06 devstack sudo[100581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:06 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:06 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:07 devstack sudo[100581]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce" returned: 0 in 0.750s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] <== create_volume: return (1765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.768s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 6.764s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1852112541',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=efc03de6-5320-4789-ab7d-1fa86a59c733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bfc2fb1b24844dd9c43b34236e43d00',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:00Z,use_quota=True,user_id='675886da81c24d549c4ba58fdbda903e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Creating volume efc03de6-5320-4789-ab7d-1fa86a59c733 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:07 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:07 devstack sudo[100587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 1073741824 Jul 06 21:19:07 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:07 devstack sudo[100587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c9e5b3e-82c2-42bc-a3ac-406abe458f37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db555f66-13bd-4569-9109-71bc760e5bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Deleted volume successfully. Jul 06 21:19:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Volume volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce (3f6435f3-ea91-49c8-aacb-e991bacd9dce): created successfully Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db555f66-13bd-4569-9109-71bc760e5bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (56716506-66e0-4dd0-92e9-17012e94720e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1e5c53ff-529a-430c-b0e7-e50cdb1051d4 tempest-VolumesGetTest-523041334 None] Lock "cinder-6ac5fc85-d3cf-4221-9027-c5095b4bddca-delete_volume" released by "delete_volume" :: held 3.788s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-840c15bc-faef-42d7-b88a-64a27abbca45 tempest-CreateVolumesFromImageTest-540395642 None] Created volume successfully. Jul 06 21:19:08 devstack sudo[100587]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 1073741824" returned: 0 in 0.971s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:08 devstack sudo[100593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 Jul 06 21:19:08 devstack sudo[100593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:08 devstack sudo[100593]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733" returned: 0 in 0.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] <== create_volume: return (1710ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf202d6d-30dc-407d-81a5-ef362943e957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-efc03de6-5320-4789-ab7d-1fa86a59c733', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7a044c-f549-45ec-bb4c-381b0d10b6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:08 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Volume volume-efc03de6-5320-4789-ab7d-1fa86a59c733 (efc03de6-5320-4789-ab7d-1fa86a59c733): created successfully Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad7a044c-f549-45ec-bb4c-381b0d10b6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Flow 'volume_create_manager' (28640eb1-bbc5-42cf-a1c3-4ab7234503fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b36abea7-fe37-42ed-891b-9e4e0119ca47 tempest-CreateVolumesFromImageTest-540395642 None] Created volume successfully. Jul 06 21:19:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-efc03de6-5320-4789-ab7d-1fa86a59c733-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-efc03de6-5320-4789-ab7d-1fa86a59c733-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-quobyte-efc03de6-5320-4789-ab7d-1fa86a59c733" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-efc03de6-5320-4789-ab7d-1fa86a59c733" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca2ff10-1b03-47cc-bf3c-60b87d5b4f2c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:09 devstack sudo[100597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 Jul 06 21:19:09 devstack sudo[100597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:10 devstack sudo[100597]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733" returned: 0 in 0.799s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:10 devstack sudo[100602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733 Jul 06 21:19:10 devstack sudo[100602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Flow 'volume_create_manager' (1fa26a05-8387-4b5d-8204-cee6676be77d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f60dc16-ce3b-4a48-a707-96dd38894853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f60dc16-ce3b-4a48-a707-96dd38894853) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1980574127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf171c-b21b-4ecd-a54f-ee79625b285e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bf50068537426298cedbbd269e24d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:10Z,use_quota=True,user_id='9308cd6c01dd4eca8bc1698019cd4c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4cd552-7ad3-41cc-80e9-769502b076e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4cd552-7ad3-41cc-80e9-769502b076e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459cdd51-3d70-46dd-971d-9dbc8fe564bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (459cdd51-3d70-46dd-971d-9dbc8fe564bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9cf171c-b21b-4ecd-a54f-ee79625b285e', 'volume_name': 'volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0367f4e7-3e3d-4399-988a-16f8e33eb516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0367f4e7-3e3d-4399-988a-16f8e33eb516) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da878ce-eb9f-4b1c-851d-a04ba46d2646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:10 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Volume b9cf171c-b21b-4ecd-a54f-ee79625b285e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e', 'volume_size': 1} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1980574127',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9cf171c-b21b-4ecd-a54f-ee79625b285e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='49bf50068537426298cedbbd269e24d8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:10Z,use_quota=True,user_id='9308cd6c01dd4eca8bc1698019cd4c7e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Creating volume b9cf171c-b21b-4ecd-a54f-ee79625b285e {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:10 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:10 devstack sudo[100604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e 1073741824 Jul 06 21:19:10 devstack sudo[100604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:10 devstack sudo[100602]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-efc03de6-5320-4789-ab7d-1fa86a59c733" returned: 0 in 0.772s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-efc03de6-5320-4789-ab7d-1fa86a59c733" released by "delete_volume" :: held 1.628s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:10 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Created reservations ['a6052775-58d7-4fd8-9f44-514b47279b8f', 'ae2a2e48-a980-40aa-b4e4-34c9e462a15b', '47566202-bfbc-428a-a22b-7f88f37b4bf5', '0e613088-8fe2-4c3e-9a25-e92361bb113b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:11 devstack sudo[100607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:11 devstack sudo[100607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:11 devstack sudo[100604]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e 1073741824" returned: 0 in 0.971s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-3f6435f3-ea91-49c8-aacb-e991bacd9dce-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:11 devstack sudo[100613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e Jul 06 21:19:11 devstack sudo[100613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-3f6435f3-ea91-49c8-aacb-e991bacd9dce-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-quobyte-3f6435f3-ea91-49c8-aacb-e991bacd9dce" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-3f6435f3-ea91-49c8-aacb-e991bacd9dce" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4e4b434-0447-479b-a67b-1dfb8c3b1412]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:11 devstack sudo[100607]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.733s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:11 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Deleted volume successfully. Jul 06 21:19:11 devstack sudo[100615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce Jul 06 21:19:11 devstack sudo[100615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e5c6774e-671c-4aa9-8f2c-28abe3be7f4e tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-efc03de6-5320-4789-ab7d-1fa86a59c733-delete_volume" released by "delete_volume" :: held 2.599s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Flow 'volume_create_manager' (955dacfb-b308-4018-98d2-abef938cca19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140b5922-586c-4051-9572-144e9a75677a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (140b5922-586c-4051-9572-144e9a75677a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1012036207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fffbc3e-b963-40bf-90a2-59760f93dd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86aa4595e5114410b7ea577561c187ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:12Z,use_quota=True,user_id='4ab640237b9a4de8b38f3f5f76124bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b720d5b3-5771-4f80-a806-b213c55837d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b720d5b3-5771-4f80-a806-b213c55837d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8954f54a-b583-4b4e-9b49-3ff195852a45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8954f54a-b583-4b4e-9b49-3ff195852a45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5fffbc3e-b963-40bf-90a2-59760f93dd3b', 'volume_name': 'volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8e3cb9-0456-4b54-964d-4f9bd07c8f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e8e3cb9-0456-4b54-964d-4f9bd07c8f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7a0502-6df7-44fc-88aa-200afa08cfa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Volume 5fffbc3e-b963-40bf-90a2-59760f93dd3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b', 'volume_size': 1} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:12 devstack sudo[100613]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e" returned: 0 in 0.753s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] <== create_volume: return (1783ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.143s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1012036207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5fffbc3e-b963-40bf-90a2-59760f93dd3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86aa4595e5114410b7ea577561c187ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:12Z,use_quota=True,user_id='4ab640237b9a4de8b38f3f5f76124bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Creating volume 5fffbc3e-b963-40bf-90a2-59760f93dd3b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:12 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:12 devstack sudo[100619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b 1073741824 Jul 06 21:19:12 devstack sudo[100619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4da878ce-eb9f-4b1c-851d-a04ba46d2646) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7c4329-dd06-4e87-bf64-1b1666cf6795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Volume volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e (b9cf171c-b21b-4ecd-a54f-ee79625b285e): created successfully Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3d7c4329-dd06-4e87-bf64-1b1666cf6795) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Flow 'volume_create_manager' (1fa26a05-8387-4b5d-8204-cee6676be77d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a0561a7f-1322-410a-8435-89181b695d89 tempest-VolumesNegativeTest-1351769942 None] Created volume successfully. Jul 06 21:19:12 devstack sudo[100615]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce" returned: 0 in 0.886s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:12 devstack sudo[100624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce Jul 06 21:19:12 devstack sudo[100624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:13 devstack sudo[100619]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b 1073741824" returned: 0 in 0.939s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:13 devstack sudo[100630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b Jul 06 21:19:13 devstack sudo[100630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:13 devstack sudo[100624]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3f6435f3-ea91-49c8-aacb-e991bacd9dce" returned: 0 in 0.707s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-3f6435f3-ea91-49c8-aacb-e991bacd9dce" released by "delete_volume" :: held 1.654s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Created reservations ['73307236-6043-49c9-a757-b9fec257cf2f', 'ecbff7d4-96c6-4d7a-8931-3d7a701d962d', '785ee149-5398-4d55-b6ec-c1f40567721b', 'e02ceafc-fe17-4681-85a4-7f79eaf65ed9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:13 devstack sudo[100635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:13 devstack sudo[100635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-4e3e6e44-d5ba-40bb-8d65-3211486dacf2-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-4e3e6e44-d5ba-40bb-8d65-3211486dacf2-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-quobyte-4e3e6e44-d5ba-40bb-8d65-3211486dacf2" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-4e3e6e44-d5ba-40bb-8d65-3211486dacf2" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a1d1535-7598-44b8-9c3f-ef1311eea633]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:13 devstack sudo[100637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 Jul 06 21:19:13 devstack sudo[100637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:14 devstack sudo[100630]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b" returned: 0 in 0.888s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] <== create_volume: return (1871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.874s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e7a0502-6df7-44fc-88aa-200afa08cfa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44123e8-0f21-46ec-aa93-699427a68ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:14 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Volume volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b (5fffbc3e-b963-40bf-90a2-59760f93dd3b): created successfully Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c44123e8-0f21-46ec-aa93-699427a68ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Flow 'volume_create_manager' (955dacfb-b308-4018-98d2-abef938cca19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ccedb8d5-0ecf-43ab-9000-8c3a56be0f22 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Created volume successfully. Jul 06 21:19:14 devstack sudo[100635]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.881s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Deleted volume successfully. Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7eacdbd2-351e-42fe-9238-66df43c9e2c7 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-3f6435f3-ea91-49c8-aacb-e991bacd9dce-delete_volume" released by "delete_volume" :: held 2.773s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:14 devstack sudo[100637]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2" returned: 0 in 0.863s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:14 devstack sudo[100644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2 Jul 06 21:19:14 devstack sudo[100644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Acquiring lock "cinder-5fffbc3e-b963-40bf-90a2-59760f93dd3b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "cinder-5fffbc3e-b963-40bf-90a2-59760f93dd3b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Acquiring lock "cinder-quobyte-5fffbc3e-b963-40bf-90a2-59760f93dd3b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "cinder-quobyte-5fffbc3e-b963-40bf-90a2-59760f93dd3b" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2902b5aa-6eed-4850-bf5c-a3171f35d0c4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:15 devstack sudo[100644]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4e3e6e44-d5ba-40bb-8d65-3211486dacf2" returned: 0 in 0.662s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-4e3e6e44-d5ba-40bb-8d65-3211486dacf2" released by "delete_volume" :: held 1.575s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Created reservations ['a332fc5f-78dc-412a-88cf-57573ca7a7ff', '9edd7565-cf6f-4891-9058-8e92de4c9f0e', '7454692a-7233-4b69-ba1d-8a49bb0331be', 'ff5a7415-99af-44dc-a69a-ad0b0df59478'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:15 devstack sudo[100647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b Jul 06 21:19:15 devstack sudo[100647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:15 devstack sudo[100649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:15 devstack sudo[100649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-quobyte-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc3acaf-139a-4afd-8060-fec11ba94410]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:16 devstack sudo[100647]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b" returned: 0 in 0.825s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:16 devstack sudo[100656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b Jul 06 21:19:16 devstack sudo[100656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:16 devstack sudo[100649]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.703s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:16 devstack sudo[100655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 Jul 06 21:19:16 devstack sudo[100655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:16 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Deleted volume successfully. Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f6bb24a4-59ab-46a6-9621-7113c055eed6 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-4e3e6e44-d5ba-40bb-8d65-3211486dacf2-delete_volume" released by "delete_volume" :: held 2.486s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:16 devstack sudo[100656]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5fffbc3e-b963-40bf-90a2-59760f93dd3b" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "cinder-quobyte-5fffbc3e-b963-40bf-90a2-59760f93dd3b" released by "delete_volume" :: held 1.547s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:16 devstack sudo[100655]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080" returned: 0 in 0.773s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:16 devstack sudo[100663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080 Jul 06 21:19:16 devstack sudo[100663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:16 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Created reservations ['00392ad3-fafd-4ca6-b570-0f1bb797d3fe', 'd9eb40f6-4975-40fa-9e25-bbcfffd1669e', '36ae5de4-28b9-4355-864f-1c1f816602a2', '4e34c83a-b4ba-4989-b311-ee579dd83c6f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:17 devstack sudo[100665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:17 devstack sudo[100665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:17 devstack sudo[100663]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080" returned: 0 in 0.706s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080" released by "delete_volume" :: held 1.529s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Created reservations ['a1f67775-6cff-4403-9c99-b6b1a1951fe2', '2d4b20a6-8310-4323-a900-8789358cce15', '527b5c2f-b783-4a23-9419-f8c9b6dd40a0', '9b3bd2da-2444-4516-8742-063efd7ec370'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:17 devstack sudo[100665]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.678s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Deleted volume successfully. Jul 06 21:19:17 devstack sudo[100669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:17 devstack sudo[100669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5ff3e7f0-25e4-48fe-93c0-7d28d60bbe19 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "cinder-5fffbc3e-b963-40bf-90a2-59760f93dd3b-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:17 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Flow 'volume_create_manager' (8a0b17b9-fab9-4f8d-b686-b71a88495abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c449fa45-30a0-49ca-9b54-bf88e6a38e8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c449fa45-30a0-49ca-9b54-bf88e6a38e8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1632693558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e654be6b-addd-408e-87e8-0b5680f7ac2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86aa4595e5114410b7ea577561c187ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:18Z,use_quota=True,user_id='4ab640237b9a4de8b38f3f5f76124bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23392a57-4acb-418d-bf51-3fbd08125396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23392a57-4acb-418d-bf51-3fbd08125396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dd8c40-37e4-4b1a-81ee-80d056a8860c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9dd8c40-37e4-4b1a-81ee-80d056a8860c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e654be6b-addd-408e-87e8-0b5680f7ac2b', 'volume_name': 'volume-e654be6b-addd-408e-87e8-0b5680f7ac2b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302c7bd5-92c9-4d4b-a320-8da2686981dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (302c7bd5-92c9-4d4b-a320-8da2686981dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1534e13-2a91-4942-8527-24cf94a6c296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:18 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Volume e654be6b-addd-408e-87e8-0b5680f7ac2b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e654be6b-addd-408e-87e8-0b5680f7ac2b', 'volume_size': 1} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1632693558',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e654be6b-addd-408e-87e8-0b5680f7ac2b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86aa4595e5114410b7ea577561c187ad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:18Z,use_quota=True,user_id='4ab640237b9a4de8b38f3f5f76124bb5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Creating volume e654be6b-addd-408e-87e8-0b5680f7ac2b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:18 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:18 devstack sudo[100671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b 1073741824 Jul 06 21:19:18 devstack sudo[100671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "cinder-quobyte-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f356128-130c-49bf-ba99-700b21d2af22]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:18 devstack sudo[100669]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.772s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:18 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Deleted volume successfully. Jul 06 21:19:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-18210996-82a6-449d-8916-54f5e0565150 tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-0bd3d1e8-a7fb-45b9-ac68-cd0933c29080-delete_volume" released by "delete_volume" :: held 2.550s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:18 devstack sudo[100674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 Jul 06 21:19:18 devstack sudo[100674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:19 devstack sudo[100671]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b 1073741824" returned: 0 in 1.097s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:19 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b Jul 06 21:19:19 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:19 devstack sudo[100674]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4" returned: 0 in 0.888s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:19 devstack sudo[100686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4 Jul 06 21:19:19 devstack sudo[100686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:19 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b" returned: 0 in 0.759s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.913s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1534e13-2a91-4942-8527-24cf94a6c296) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e654be6b-addd-408e-87e8-0b5680f7ac2b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a241b2d0-fa55-4892-8a61-202484283773) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Volume volume-e654be6b-addd-408e-87e8-0b5680f7ac2b (e654be6b-addd-408e-87e8-0b5680f7ac2b): created successfully Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a241b2d0-fa55-4892-8a61-202484283773) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Flow 'volume_create_manager' (8a0b17b9-fab9-4f8d-b686-b71a88495abc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-74a9daa4-14b9-471d-b6c5-562657296b76 tempest-VolumeQuotasAdminTestJSON-2120842967 None] Created volume successfully. Jul 06 21:19:20 devstack sudo[100686]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4" returned: 0 in 0.838s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-quobyte-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4" released by "delete_volume" :: held 1.780s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Created reservations ['1fec59fa-f2dd-468e-aaf1-917161ad0950', '438473bb-758f-4ca5-9950-08eede7cf0ee', 'c5dc4680-7b17-40ca-8899-7455b97b0283', '1b865523-a878-424d-bfdb-fdb3205816fe'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:20 devstack sudo[100694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:20 devstack sudo[100694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:21 devstack sudo[100694]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.796s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:21 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Deleted volume successfully. Jul 06 21:19:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d8874d3-5157-4a78-9444-8ffc6618abcb tempest-CreateVolumesFromImageTest-540395642 None] Lock "cinder-8f8f877d-7b7e-4885-b19c-ac62cf24b3f4-delete_volume" released by "delete_volume" :: held 2.815s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-61730255-d4b8-4a39-82f3-d8ac69cb0e54 tempest-VolumeQuotasAdminTestJSON-1674411524 None] Transfer volume completed successfully. Jul 06 21:19:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Acquiring lock "cinder-e654be6b-addd-408e-87e8-0b5680f7ac2b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Lock "cinder-e654be6b-addd-408e-87e8-0b5680f7ac2b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Acquiring lock "cinder-quobyte-e654be6b-addd-408e-87e8-0b5680f7ac2b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Lock "cinder-quobyte-e654be6b-addd-408e-87e8-0b5680f7ac2b" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:23 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[32f5a4ea-afc1-4b6d-a8fb-96330ac04faf]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:23 devstack sudo[100710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b Jul 06 21:19:23 devstack sudo[100710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:23 devstack sudo[100710]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b" returned: 0 in 0.807s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:23 devstack sudo[100715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b Jul 06 21:19:23 devstack sudo[100715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Flow 'volume_create_manager' (6f381f1e-d13c-43f1-944f-4a811d2d521a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd16cf7-99e6-472e-b803-90fec115e130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbd16cf7-99e6-472e-b803-90fec115e130) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986133533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f86b72-d18b-497f-9055-dead2a1344b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d168f55152bf4dd8a05d42d075a3dfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:24Z,use_quota=True,user_id='8f0730bd698646a6a91a5585607ac627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5fbe01-7295-47dc-805e-35e68655cdb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf5fbe01-7295-47dc-805e-35e68655cdb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14beaf97-a1ff-4fe0-ad5a-2014aa8b06e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (14beaf97-a1ff-4fe0-ad5a-2014aa8b06e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0f86b72-d18b-497f-9055-dead2a1344b8', 'volume_name': 'volume-c0f86b72-d18b-497f-9055-dead2a1344b8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f532044-86ed-4b0b-88a5-b00733509cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f532044-86ed-4b0b-88a5-b00733509cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a89928-4c24-4268-a759-00da97fbdf1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:24 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Volume c0f86b72-d18b-497f-9055-dead2a1344b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0f86b72-d18b-497f-9055-dead2a1344b8', 'volume_size': 1} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1986133533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0f86b72-d18b-497f-9055-dead2a1344b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d168f55152bf4dd8a05d42d075a3dfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:24Z,use_quota=True,user_id='8f0730bd698646a6a91a5585607ac627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Creating volume c0f86b72-d18b-497f-9055-dead2a1344b8 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:24 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:24 devstack sudo[100715]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:24 devstack sudo[100748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 1073741824 Jul 06 21:19:24 devstack sudo[100748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e654be6b-addd-408e-87e8-0b5680f7ac2b" returned: 0 in 0.875s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Lock "cinder-quobyte-e654be6b-addd-408e-87e8-0b5680f7ac2b" released by "delete_volume" :: held 1.737s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Created reservations ['bae2294a-64c6-4b4c-bae5-f62e15ea11e2', 'ed737e31-a782-4e1b-b61c-13950ff2f991', '59a3b32c-2c20-4faf-9472-3306572448cc', 'f1f94167-283a-4d39-9663-7b4f29e4d54f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:24 devstack sudo[100756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:24 devstack sudo[100756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:25 devstack sudo[100756]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:25 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Deleted volume successfully. Jul 06 21:19:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c9d47c20-cc3d-4446-859b-53fd66c0d5d2 tempest-VolumeQuotasAdminTestJSON-1825905878 None] Lock "cinder-e654be6b-addd-408e-87e8-0b5680f7ac2b-delete_volume" released by "delete_volume" :: held 2.851s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:25 devstack sudo[100748]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 1073741824" returned: 0 in 1.148s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:25 devstack sudo[100773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 Jul 06 21:19:25 devstack sudo[100773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:26 devstack sudo[100773]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8" returned: 0 in 0.723s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] <== create_volume: return (1916ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.918s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21a89928-4c24-4268-a759-00da97fbdf1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0f86b72-d18b-497f-9055-dead2a1344b8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05be4c-8a20-4b0f-b75a-ad2f0ba532ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:26 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Volume volume-c0f86b72-d18b-497f-9055-dead2a1344b8 (c0f86b72-d18b-497f-9055-dead2a1344b8): created successfully Jul 06 21:19:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe05be4c-8a20-4b0f-b75a-ad2f0ba532ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:26 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Flow 'volume_create_manager' (6f381f1e-d13c-43f1-944f-4a811d2d521a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-527bc2a7-7a81-46b6-a82a-a0f80e9e21fa tempest-ProjectReaderTests-20253414 None] Created volume successfully. Jul 06 21:19:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Acquiring lock "cinder-c0f86b72-d18b-497f-9055-dead2a1344b8-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Lock "cinder-c0f86b72-d18b-497f-9055-dead2a1344b8-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Acquiring lock "cinder-quobyte-c0f86b72-d18b-497f-9055-dead2a1344b8" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Lock "cinder-quobyte-c0f86b72-d18b-497f-9055-dead2a1344b8" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[247ce7c9-de2f-4618-80b5-7060e1697805]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:28 devstack sudo[100797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 Jul 06 21:19:28 devstack sudo[100797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:29 devstack sudo[100797]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8" returned: 0 in 1.158s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:29 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8 Jul 06 21:19:29 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:29 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c0f86b72-d18b-497f-9055-dead2a1344b8" returned: 0 in 0.777s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Lock "cinder-quobyte-c0f86b72-d18b-497f-9055-dead2a1344b8" released by "delete_volume" :: held 1.997s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Created reservations ['78e11a2b-ed48-4c07-937c-7e793a5d0989', '524c19bd-b88e-4ed0-b9c0-b05c42f635f2', 'eabdac22-0b8d-414a-889a-d240cdde01a6', 'c782ac9d-c359-436a-a821-738e8e296077'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:30 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:30 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Flow 'volume_create_manager' (26bb477d-9fcd-46a1-ba07-d762452fffae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a32e96-608b-495a-a133-635f5fdbd640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6a32e96-608b-495a-a133-635f5fdbd640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97967496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a270fcec-c3ad-431d-bd3f-597cc978f270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d168f55152bf4dd8a05d42d075a3dfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:31Z,use_quota=True,user_id='8f0730bd698646a6a91a5585607ac627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7a456d-d2c5-4add-b4f4-cc4a0fdd272d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b7a456d-d2c5-4add-b4f4-cc4a0fdd272d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d278bf-4cc3-4933-93a8-5840ddc134f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3d278bf-4cc3-4933-93a8-5840ddc134f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a270fcec-c3ad-431d-bd3f-597cc978f270', 'volume_name': 'volume-a270fcec-c3ad-431d-bd3f-597cc978f270', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16edb6f5-262a-4a41-b99e-42b1b429d616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16edb6f5-262a-4a41-b99e-42b1b429d616) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5862ee5b-3245-44a8-83ef-9c3af2a3d7df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Volume a270fcec-c3ad-431d-bd3f-597cc978f270: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a270fcec-c3ad-431d-bd3f-597cc978f270', 'volume_size': 1} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-97967496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a270fcec-c3ad-431d-bd3f-597cc978f270,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d168f55152bf4dd8a05d42d075a3dfff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:31Z,use_quota=True,user_id='8f0730bd698646a6a91a5585607ac627',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Creating volume a270fcec-c3ad-431d-bd3f-597cc978f270 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:30 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:30 devstack sudo[100815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 1073741824 Jul 06 21:19:30 devstack sudo[100815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:31 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.888s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:31 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Deleted volume successfully. Jul 06 21:19:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7857c0d-06e5-4b2a-aaa0-2b2cc6969a8f tempest-ProjectReaderTests-20253414 None] Lock "cinder-c0f86b72-d18b-497f-9055-dead2a1344b8-delete_volume" released by "delete_volume" :: held 3.188s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:32 devstack sudo[100815]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 1073741824" returned: 0 in 1.159s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:32 devstack sudo[100837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 Jul 06 21:19:32 devstack sudo[100837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:32 devstack sudo[100837]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] <== create_volume: return (1903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.906s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5862ee5b-3245-44a8-83ef-9c3af2a3d7df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a270fcec-c3ad-431d-bd3f-597cc978f270', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f8129b-cc42-4ceb-b4d9-0cf1658b06a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:32 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Volume volume-a270fcec-c3ad-431d-bd3f-597cc978f270 (a270fcec-c3ad-431d-bd3f-597cc978f270): created successfully Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92f8129b-cc42-4ceb-b4d9-0cf1658b06a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Flow 'volume_create_manager' (26bb477d-9fcd-46a1-ba07-d762452fffae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0e70cb69-7260-4dab-af82-cb8dd9d3582f tempest-ProjectReaderTests-20253414 None] Created volume successfully. Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Flow 'volume_create_manager' (ba300eda-57e7-4a52-b43e-d150485249c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8904e011-3aa8-4de8-9a4d-2d9a091ab6ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8904e011-3aa8-4de8-9a4d-2d9a091ab6ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1831139151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b586fb-85a8-4ff0-8bcb-c90e05dbe442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa3f47f7fc4bf1a62b27aca100b0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:33Z,use_quota=True,user_id='e7674cdc2ef84770bf1a1bb74054210d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf2553c-dcda-48c0-b173-0d0d3db36c21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2bf2553c-dcda-48c0-b173-0d0d3db36c21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682d84b4-ec3c-4e07-80b4-9ec799418587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (682d84b4-ec3c-4e07-80b4-9ec799418587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1b586fb-85a8-4ff0-8bcb-c90e05dbe442', 'volume_name': 'volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c893bbee-c5be-4a79-8497-3e1ef77ed6d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c893bbee-c5be-4a79-8497-3e1ef77ed6d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5f6a57-b946-4b04-9690-5fee9c01ba87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:33 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Volume d1b586fb-85a8-4ff0-8bcb-c90e05dbe442: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442', 'volume_size': 1} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1831139151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1b586fb-85a8-4ff0-8bcb-c90e05dbe442,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fa3f47f7fc4bf1a62b27aca100b0dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:33Z,use_quota=True,user_id='e7674cdc2ef84770bf1a1bb74054210d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Creating volume d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:33 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:33 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 1073741824 Jul 06 21:19:33 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Acquiring lock "cinder-a270fcec-c3ad-431d-bd3f-597cc978f270-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Lock "cinder-a270fcec-c3ad-431d-bd3f-597cc978f270-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Acquiring lock "cinder-quobyte-a270fcec-c3ad-431d-bd3f-597cc978f270" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Lock "cinder-quobyte-a270fcec-c3ad-431d-bd3f-597cc978f270" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a26d8d7-0b1e-4403-955d-b341da4b64a7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:34 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 Jul 06 21:19:34 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:34 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 1073741824" returned: 0 in 0.892s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:34 devstack sudo[100849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 Jul 06 21:19:34 devstack sudo[100849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:34 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270" returned: 0 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:34 devstack sudo[100854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270 Jul 06 21:19:34 devstack sudo[100854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:35 devstack sudo[100849]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442" returned: 0 in 0.660s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] <== create_volume: return (1592ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c5f6a57-b946-4b04-9690-5fee9c01ba87) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cfbdf6-964b-47ce-84b7-7abab10dc91b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Volume volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 (d1b586fb-85a8-4ff0-8bcb-c90e05dbe442): created successfully Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36cfbdf6-964b-47ce-84b7-7abab10dc91b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Flow 'volume_create_manager' (ba300eda-57e7-4a52-b43e-d150485249c2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7ff55b25-3948-4134-89d1-2dbc22fa005f tempest-VolumeQuotasNegativeTestJSON-189676174 None] Created volume successfully. Jul 06 21:19:35 devstack sudo[100854]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a270fcec-c3ad-431d-bd3f-597cc978f270" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Lock "cinder-quobyte-a270fcec-c3ad-431d-bd3f-597cc978f270" released by "delete_volume" :: held 1.538s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Created reservations ['a7a67075-b2ae-4eea-9df7-ce23be4d139c', '5328030a-4c39-4913-aed9-302c23ba3594', '8ff1d76d-f406-48d7-b1ca-864c515756f4', '99d83b02-fc40-40ff-b378-93155545c9af'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:35 devstack sudo[100858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:35 devstack sudo[100858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:36 devstack sudo[100858]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.699s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Deleted volume successfully. Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-0f4c9264-1572-442d-94b3-62c5d624b520 tempest-ProjectReaderTests-20253414 None] Lock "cinder-a270fcec-c3ad-431d-bd3f-597cc978f270-delete_volume" released by "delete_volume" :: held 2.460s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Acquiring lock "cinder-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "cinder-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Acquiring lock "cinder-quobyte-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "cinder-quobyte-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cab3abe-e738-4abd-80ec-dfeac48eca3e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:36 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 Jul 06 21:19:36 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:37 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442" returned: 0 in 0.814s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:37 devstack sudo[100866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442 Jul 06 21:19:37 devstack sudo[100866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:38 devstack sudo[100866]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442" returned: 0 in 0.746s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "cinder-quobyte-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442" released by "delete_volume" :: held 1.641s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Created reservations ['3888c046-9f07-4f99-b9eb-dae7b06a6ada', 'c7e3c3a8-e3ae-4100-a27f-36913f7b36b2', '862675dd-a810-414e-ba1a-6f19c31243ce', '2a4bd2a0-8caa-40bd-94db-d703f4a19c64'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:38 devstack sudo[100869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:38 devstack sudo[100869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:39 devstack sudo[100869]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.714s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:39 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Deleted volume successfully. Jul 06 21:19:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-65b0f239-26f5-4415-847b-3ff4276e5d8e tempest-VolumeQuotasNegativeTestJSON-189676174 None] Lock "cinder-d1b586fb-85a8-4ff0-8bcb-c90e05dbe442-delete_volume" released by "delete_volume" :: held 2.603s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Acquiring lock "cinder-b9cf171c-b21b-4ecd-a54f-ee79625b285e-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Lock "cinder-b9cf171c-b21b-4ecd-a54f-ee79625b285e-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=121,cinder:DELETE=19,cinder:INSERT=43,cinder:UPDATE=178 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=120,cinder:INSERT=51,cinder:UPDATE=176,cinder:DELETE=12 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Acquiring lock "cinder-quobyte-b9cf171c-b21b-4ecd-a54f-ee79625b285e" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Lock "cinder-quobyte-b9cf171c-b21b-4ecd-a54f-ee79625b285e" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[59e40351-d2b2-40c7-812b-c793a18a3172]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:44 devstack sudo[100874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e Jul 06 21:19:44 devstack sudo[100874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Flow 'volume_create_manager' (de0d4f54-9656-4728-9d48-6b2e6dc15b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4dbb1e-14f4-49c2-9fba-03dd112591a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5b4dbb1e-14f4-49c2-9fba-03dd112591a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1573541666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcbf9de-384a-4833-a0cc-03b1f77ec156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced5d64e95d1402aa93e35fcd519bdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:45Z,use_quota=True,user_id='dfa11524b8f3461f983068810ff34597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea43a502-1294-4135-9c17-0a22c0bf7a82),volume_type_id=ea43a502-1294-4135-9c17-0a22c0bf7a82)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e6e4a6-e106-4e19-b182-dbd58b376595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d7e6e4a6-e106-4e19-b182-dbd58b376595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279520e9-0ad8-4d07-84e3-eaa4e9a24660) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (279520e9-0ad8-4d07-84e3-eaa4e9a24660) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4fcbf9de-384a-4833-a0cc-03b1f77ec156', 'volume_name': 'volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61e297b-dbaa-457d-946b-019618d87b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e61e297b-dbaa-457d-946b-019618d87b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6e2537-e95b-4a6f-b79e-9aee89d7c940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:45 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Volume 4fcbf9de-384a-4833-a0cc-03b1f77ec156: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156', 'volume_size': 1} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-1573541666',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4fcbf9de-384a-4833-a0cc-03b1f77ec156,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ced5d64e95d1402aa93e35fcd519bdf2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:45Z,use_quota=True,user_id='dfa11524b8f3461f983068810ff34597',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ea43a502-1294-4135-9c17-0a22c0bf7a82),volume_type_id=ea43a502-1294-4135-9c17-0a22c0bf7a82)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Creating volume 4fcbf9de-384a-4833-a0cc-03b1f77ec156 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:45 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:45 devstack sudo[100880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 1073741824 Jul 06 21:19:45 devstack sudo[100880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:45 devstack sudo[100874]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e" returned: 0 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:45 devstack sudo[100882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e Jul 06 21:19:45 devstack sudo[100882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:46 devstack sudo[100882]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b9cf171c-b21b-4ecd-a54f-ee79625b285e" returned: 0 in 0.651s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Lock "cinder-quobyte-b9cf171c-b21b-4ecd-a54f-ee79625b285e" released by "delete_volume" :: held 1.492s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Created reservations ['ef5797e6-6ffb-4041-8ff9-35f161d82385', '015133a3-37a5-4f48-a3e0-cf7ef9c6f3fc', '5d5fc7d4-8371-4194-9569-f8c8638af9cf', '71837129-461f-4ef6-aaf9-1a165584237f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:46 devstack sudo[100880]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 1073741824" returned: 0 in 0.825s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:46 devstack sudo[100888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 Jul 06 21:19:46 devstack sudo[100888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:46 devstack sudo[100890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:46 devstack sudo[100890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:47 devstack sudo[100888]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156" returned: 0 in 0.637s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] <== create_volume: return (1514ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.517s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bf6e2537-e95b-4a6f-b79e-9aee89d7c940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2952a1-84e3-45dc-b49c-108ac16aa061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:47 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Volume volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 (4fcbf9de-384a-4833-a0cc-03b1f77ec156): created successfully Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f2952a1-84e3-45dc-b49c-108ac16aa061) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Flow 'volume_create_manager' (de0d4f54-9656-4728-9d48-6b2e6dc15b39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:47 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-12f591b6-f2c0-44b2-91c9-1b89647752ae tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Created volume successfully. Jul 06 21:19:47 devstack sudo[100890]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:47 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Deleted volume successfully. Jul 06 21:19:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd5bc8f1-6093-479d-be7d-399234c19cf3 tempest-VolumesNegativeTest-1351769942 None] Lock "cinder-b9cf171c-b21b-4ecd-a54f-ee79625b285e-delete_volume" released by "delete_volume" :: held 2.467s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:48 devstack sudo[100929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:48 devstack sudo[100929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:48 devstack sudo[100929]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.700s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:48 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:48 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f05a9ec8-069a-4594-9180-b566a337f9ac tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Retype volume completed successfully. Jul 06 21:19:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Acquiring lock "cinder-4fcbf9de-384a-4833-a0cc-03b1f77ec156-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "cinder-4fcbf9de-384a-4833-a0cc-03b1f77ec156-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Acquiring lock "cinder-quobyte-4fcbf9de-384a-4833-a0cc-03b1f77ec156" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:19:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "cinder-quobyte-4fcbf9de-384a-4833-a0cc-03b1f77ec156" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:19:49 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4570425a-0322-4deb-b5da-0f6f004fe21c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:19:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:49 devstack sudo[100937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 Jul 06 21:19:49 devstack sudo[100937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:50 devstack sudo[100937]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156" returned: 0 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:50 devstack sudo[100942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156 Jul 06 21:19:50 devstack sudo[100942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:50 devstack sudo[100942]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4fcbf9de-384a-4833-a0cc-03b1f77ec156" returned: 0 in 0.658s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "cinder-quobyte-4fcbf9de-384a-4833-a0cc-03b1f77ec156" released by "delete_volume" :: held 1.513s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:50 devstack cinder-volume[87273]: WARNING cinder.quota [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:19:50 devstack cinder-volume[87273]: WARNING cinder.quota [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Created reservations ['07741a43-ec7d-445e-ae2c-6ead8fad1974', '4081cc62-be25-4f47-84f1-ab3d56a905cc', '697157de-b9e0-445e-86c7-1ddaf4e2ecda', '137dfb3b-3c3b-48e8-9ffb-ee054af75742'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:50 devstack sudo[100945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:19:50 devstack sudo[100945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:51 devstack sudo[100945]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.676s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:51 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:19:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Deleted volume successfully. Jul 06 21:19:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23cec6bc-5711-4d4b-9938-f8ce48d8ea20 tempest-VolumeRetypeWithoutMigrationTest-356112541 None] Lock "cinder-4fcbf9de-384a-4833-a0cc-03b1f77ec156-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Flow 'volume_create_manager' (fe6246e0-111e-4cbc-b696-cf990b00a137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560704d6-5530-4cda-a4a9-0fee2673ac4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (560704d6-5530-4cda-a4a9-0fee2673ac4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2027897956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625d7414-e6d2-4612-b4d5-59135de5666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae55485ebdf24ad99c1752d4532f3fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:58Z,use_quota=True,user_id='f1e656f82aba45d1b6330d93d7f495ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91127716-eeb5-4819-95cd-cd91d3362c90),volume_type_id=91127716-eeb5-4819-95cd-cd91d3362c90)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40c91f8-864a-4fa6-8647-8774791f65bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b40c91f8-864a-4fa6-8647-8774791f65bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c276ceb2-6526-4991-b46b-7974db82d4c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c276ceb2-6526-4991-b46b-7974db82d4c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '625d7414-e6d2-4612-b4d5-59135de5666a', 'volume_name': 'volume-625d7414-e6d2-4612-b4d5-59135de5666a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381cf6d6-0eaf-4bee-877b-538ccfaf8424) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (381cf6d6-0eaf-4bee-877b-538ccfaf8424) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809837c0-0df5-4188-b1b1-bbc65935d1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Volume 625d7414-e6d2-4612-b4d5-59135de5666a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-625d7414-e6d2-4612-b4d5-59135de5666a', 'volume_size': 1} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:19:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-2027897956',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=625d7414-e6d2-4612-b4d5-59135de5666a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae55485ebdf24ad99c1752d4532f3fce',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:19:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:19:58Z,use_quota=True,user_id='f1e656f82aba45d1b6330d93d7f495ec',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(91127716-eeb5-4819-95cd-cd91d3362c90),volume_type_id=91127716-eeb5-4819-95cd-cd91d3362c90)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Creating volume 625d7414-e6d2-4612-b4d5-59135de5666a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:19:57 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:19:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:57 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a 1073741824 Jul 06 21:19:57 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:58 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a 1073741824" returned: 0 in 0.975s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:19:59 devstack sudo[100965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a Jul 06 21:19:59 devstack sudo[100965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:19:59 devstack sudo[100965]: pam_unix(sudo:session): session closed for user root Jul 06 21:19:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:19:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] <== create_volume: return (1728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:19:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.731s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:19:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809837c0-0df5-4188-b1b1-bbc65935d1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-625d7414-e6d2-4612-b4d5-59135de5666a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb063b9a-7ffc-49ef-b26c-f1554d7d6741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:19:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Volume volume-625d7414-e6d2-4612-b4d5-59135de5666a (625d7414-e6d2-4612-b4d5-59135de5666a): created successfully Jul 06 21:19:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cb063b9a-7ffc-49ef-b26c-f1554d7d6741) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:19:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Flow 'volume_create_manager' (fe6246e0-111e-4cbc-b696-cf990b00a137) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:19:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-caf67042-d4a5-4517-9a60-d5f3c37b5d28 tempest-VolumeTypesAccessTest-327934833 None] Created volume successfully. Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Acquiring lock "cinder-625d7414-e6d2-4612-b4d5-59135de5666a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Lock "cinder-625d7414-e6d2-4612-b4d5-59135de5666a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Acquiring lock "cinder-quobyte-625d7414-e6d2-4612-b4d5-59135de5666a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Lock "cinder-quobyte-625d7414-e6d2-4612-b4d5-59135de5666a" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4ad6d92-ab1e-4739-bd1f-a914de2b3ddf]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:00 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a Jul 06 21:20:00 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:00 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a" returned: 0 in 0.813s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:00 devstack sudo[100973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a Jul 06 21:20:00 devstack sudo[100973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:01 devstack sudo[100975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:20:01 devstack sudo[100975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:01 devstack sudo[100973]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-625d7414-e6d2-4612-b4d5-59135de5666a" returned: 0 in 0.652s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Lock "cinder-quobyte-625d7414-e6d2-4612-b4d5-59135de5666a" released by "delete_volume" :: held 1.519s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:20:01 devstack cinder-volume[87273]: WARNING cinder.quota [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1765149111 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1765149111, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:20:01 devstack cinder-volume[87273]: WARNING cinder.quota [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1765149111 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1765149111, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Created reservations ['8f6f06fb-cd83-4e73-b018-b6670cb314e5', 'a436c889-ae52-4f1c-8df5-0ffbedc77b5e', 'ee7d3bb8-6621-477c-b31d-d467a4c0c998', 'ae08428d-e628-4bf7-87d7-dbad5fedfbbe'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:01 devstack sudo[100979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:20:01 devstack sudo[100979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:01 devstack sudo[100975]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.694s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:20:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:20:02 devstack sudo[100979]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:20:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Deleted volume successfully. Jul 06 21:20:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-99d9c965-c006-47f5-a7f9-9fa21e7fa790 tempest-VolumeTypesAccessTest-327934833 None] Lock "cinder-625d7414-e6d2-4612-b4d5-59135de5666a-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:20:11 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=25,cinder:INSERT=5,cinder:UPDATE=35,cinder:DELETE=3 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:20:12 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=26,cinder:UPDATE=33,cinder:INSERT=9,cinder:DELETE=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Flow 'volume_create_manager' (3a3aa5c0-de76-4a86-9549-136b9aa934d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb664e9-9d73-4148-9826-0172de11e717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cb664e9-9d73-4148-9826-0172de11e717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1312643667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07868091-7571-4204-bb77-84a451b33d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a1ef601b1c486da35fd9bef631dc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:14Z,use_quota=True,user_id='042a5522fcd0422b880fd459562ac1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e684752-b0b8-4e27-aad5-4febd0d4c62a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e684752-b0b8-4e27-aad5-4febd0d4c62a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791d7780-9917-43e0-a16a-5fc264c97798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:13 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (791d7780-9917-43e0-a16a-5fc264c97798) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '07868091-7571-4204-bb77-84a451b33d01', 'volume_name': 'volume-07868091-7571-4204-bb77-84a451b33d01', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb60e7f-d7f4-4db8-869f-d3e0d5c562e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bdb60e7f-d7f4-4db8-869f-d3e0d5c562e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71769a23-77bc-498b-9465-ad991690bec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:14 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Volume 07868091-7571-4204-bb77-84a451b33d01: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-07868091-7571-4204-bb77-84a451b33d01', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Trying to clone 07868091-7571-4204-bb77-84a451b33d01 from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:20:14 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Image download 20.69 MB at 20.69 MB/s Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[da50c5c4-2471-46a2-be39-f71f4651e865]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:14 devstack sudo[100984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD Jul 06 21:20:14 devstack sudo[100984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:15 devstack sudo[100984]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD" returned: 0 in 0.721s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:15 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f is fetched for user 042a5522fcd0422b880fd459562ac1fd. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:20:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2032f4a7-1058-4a03-b7a7-1ac91f61fd23]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:15 devstack sudo[100989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD Jul 06 21:20:15 devstack sudo[100989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:16 devstack sudo[100989]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1312643667',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07868091-7571-4204-bb77-84a451b33d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7a1ef601b1c486da35fd9bef631dc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:14Z,use_quota=True,user_id='042a5522fcd0422b880fd459562ac1fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Creating volume 07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:20:16 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:20:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:16 devstack sudo[100994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 1073741824 Jul 06 21:20:16 devstack sudo[100994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:17 devstack sudo[100994]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 1073741824" returned: 0 in 0.860s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:17 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:20:17 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:17 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 0 in 0.676s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.588s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Attempting download of 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 07868091-7571-4204-bb77-84a451b33d01. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dc35509-ca41-41e5-a11e-e6b85eb30e00]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_vaay5iep {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:17 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_vaay5iep Jul 06 21:20:17 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:18 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_vaay5iep" returned: 0 in 0.743s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_vaay5iep {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:18 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_vaay5iep Jul 06 21:20:18 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:19 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_vaay5iep" returned: 1 in 0.747s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_vaay5iep' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:20:19 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[31da7e55-314d-47d1-ba82-cd0f249ec159]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:19 devstack sudo[101012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD Jul 06 21:20:19 devstack sudo[101012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:20 devstack sudo[101012]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f was qcow2, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:20 devstack sudo[101017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:20:20 devstack sudo[101017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Flow 'volume_create_manager' (fac3aaa7-27d7-4996-919d-f7ab86e9d971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad51d6d-1934-4778-a661-8e7e4a2685dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aad51d6d-1934-4778-a661-8e7e4a2685dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1875599146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912ee434-3638-4ce8-8481-a5aa10d95680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0424c3c0260e4d66a01eaa91c82eff1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:21Z,use_quota=True,user_id='da1eb09d4c0b4fd2b84abea24bf1dae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2b3961-eb27-4e4b-9829-66a0b7611f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb2b3961-eb27-4e4b-9829-66a0b7611f5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0d2585-389d-4f91-a25b-ad94496dae62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0d2585-389d-4f91-a25b-ad94496dae62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '912ee434-3638-4ce8-8481-a5aa10d95680', 'volume_name': 'volume-912ee434-3638-4ce8-8481-a5aa10d95680', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccf2a7b-f291-4d2d-a96a-c9bb686f9001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ccf2a7b-f291-4d2d-a96a-c9bb686f9001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45c836d-aba6-46d5-a359-0368d8104a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:21 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Volume 912ee434-3638-4ce8-8481-a5aa10d95680: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-912ee434-3638-4ce8-8481-a5aa10d95680', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Trying to clone 912ee434-3638-4ce8-8481-a5aa10d95680 from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f at location (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:20:21 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Image download 20.69 MB at 20.69 MB/s Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c93a962-11d1-42be-8f49-83992cd1fe98]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:21 devstack sudo[101026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD Jul 06 21:20:21 devstack sudo[101026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:22 devstack sudo[101017]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 0 in 1.917s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_54vw64cvdevstack@QuobyteHD, size 112.00 MB, duration 1.92 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:20:22 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Converted 112.00 MB image at 58.37 MB/s Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:22 devstack sudo[101028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 1G Jul 06 21:20:22 devstack sudo[101028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:22 devstack sudo[101026]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD" returned: 0 in 0.797s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f is fetched for user da1eb09d4c0b4fd2b84abea24bf1dae5. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[00a5ba18-4984-4438-b625-89577ceed779]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:22 devstack sudo[101033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD Jul 06 21:20:22 devstack sudo[101033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:22 devstack sudo[101028]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 1G" returned: 0 in 0.735s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e5d1ca5-88ad-43b8-856c-e654c4169cd4]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:22 devstack sudo[101038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:20:22 devstack sudo[101038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:23 devstack sudo[101033]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD" returned: 0 in 0.777s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1875599146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=912ee434-3638-4ce8-8481-a5aa10d95680,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0424c3c0260e4d66a01eaa91c82eff1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:21Z,use_quota=True,user_id='da1eb09d4c0b4fd2b84abea24bf1dae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Creating volume 912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:20:23 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:23 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 1073741824 Jul 06 21:20:23 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:23 devstack sudo[101038]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 0 in 0.746s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:23 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:20:23 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:24 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 1073741824" returned: 0 in 0.836s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:24 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 Jul 06 21:20:24 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:24 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 1 in 0.751s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Downloaded image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 07868091-7571-4204-bb77-84a451b33d01 successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f for user 042a5522fcd0422b880fd459562ac1fd is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Marking volume 07868091-7571-4204-bb77-84a451b33d01 as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Copying metadata from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f to 07868091-7571-4204-bb77-84a451b33d01. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Creating volume glance metadata for volume 07868091-7571-4204-bb77-84a451b33d01 backed by image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71769a23-77bc-498b-9465-ad991690bec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07868091-7571-4204-bb77-84a451b33d01', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443167d7-0aef-4884-aa69-4876038b2173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:24 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Volume volume-07868091-7571-4204-bb77-84a451b33d01 (07868091-7571-4204-bb77-84a451b33d01): created successfully Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (443167d7-0aef-4884-aa69-4876038b2173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Flow 'volume_create_manager' (3a3aa5c0-de76-4a86-9549-136b9aa934d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8108354f-31dc-43a4-a191-007592d43757 tempest-TestShelveInstance-1401255239 None] Created volume successfully. Jul 06 21:20:24 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680" returned: 0 in 0.677s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.568s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Attempting download of 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 912ee434-3638-4ce8-8481-a5aa10d95680. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[63abd04b-cc4a-45b5-99eb-2b772b37e91d]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_20w7ayxu {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:25 devstack sudo[101058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_20w7ayxu Jul 06 21:20:25 devstack sudo[101058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:25 devstack sudo[101058]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_20w7ayxu" returned: 0 in 0.736s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_20w7ayxu {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:25 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_20w7ayxu Jul 06 21:20:25 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:26 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_20w7ayxu" returned: 1 in 0.763s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_20w7ayxu' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:20:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[98d4c5d5-d8bc-45ed-8a48-1c4cd10bc381]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:26 devstack sudo[101069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD Jul 06 21:20:26 devstack sudo[101069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:27 devstack sudo[101069]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD" returned: 0 in 0.750s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:27 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f was qcow2, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:20:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:27 devstack sudo[101074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 Jul 06 21:20:27 devstack sudo[101074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:29 devstack sudo[101074]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680" returned: 0 in 1.803s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:29 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4a68280c-4004-4ad3-aed5-dfc9d26e2b6f_t3efqqyldevstack@QuobyteHD, size 112.00 MB, duration 1.80 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:20:29 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Converted 112.00 MB image at 62.06 MB/s Jul 06 21:20:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:29 devstack sudo[101088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 1G Jul 06 21:20:29 devstack sudo[101088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:29 devstack sudo[101088]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 1G" returned: 0 in 0.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3835b491-81fe-481c-8a74-24cadeaedc15]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:29 devstack sudo[101093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 Jul 06 21:20:29 devstack sudo[101093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:30 devstack sudo[101093]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680" returned: 0 in 0.762s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:30 devstack sudo[101097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 Jul 06 21:20:30 devstack sudo[101097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:31 devstack sudo[101097]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680" returned: 1 in 0.766s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Downloaded image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f ((None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}])) to volume 912ee434-3638-4ce8-8481-a5aa10d95680 successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Temporary image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f for user da1eb09d4c0b4fd2b84abea24bf1dae5 is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Marking volume 912ee434-3638-4ce8-8481-a5aa10d95680 as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Copying metadata from image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f to 912ee434-3638-4ce8-8481-a5aa10d95680. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Creating volume glance metadata for volume 912ee434-3638-4ce8-8481-a5aa10d95680 backed by image 4a68280c-4004-4ad3-aed5-dfc9d26e2b6f with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a45c836d-aba6-46d5-a359-0368d8104a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-912ee434-3638-4ce8-8481-a5aa10d95680', 'volume_size': 1, 'image_id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '97ee2f1993d2439eae0605fae0bfb7d1', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4a68280c-4004-4ad3-aed5-dfc9d26e2b6f', 'created_at': datetime.datetime(2026, 7, 6, 18, 58, 56, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 18, 58, 57, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4a68280c-4004-4ad3-aed5-dfc9d26e2b6f/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce0607-0684-47a1-90a9-e7d4700c864a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:31 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Volume volume-912ee434-3638-4ce8-8481-a5aa10d95680 (912ee434-3638-4ce8-8481-a5aa10d95680): created successfully Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bce0607-0684-47a1-90a9-e7d4700c864a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Flow 'volume_create_manager' (fac3aaa7-27d7-4996-919d-f7ab86e9d971) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:31 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4f4c3110-e42b-4d7b-9c97-0a0cb73660ca tempest-VolumesImageMetadata-1260567873 None] Created volume successfully. Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Acquiring lock "cinder-912ee434-3638-4ce8-8481-a5aa10d95680-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Lock "cinder-912ee434-3638-4ce8-8481-a5aa10d95680-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Acquiring lock "cinder-quobyte-912ee434-3638-4ce8-8481-a5aa10d95680" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Lock "cinder-quobyte-912ee434-3638-4ce8-8481-a5aa10d95680" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f44f8ab6-a07b-4c80-96ae-a1faa7786334]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:32 devstack sudo[101102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 Jul 06 21:20:32 devstack sudo[101102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8b6914d-9813-4770-8963-5a309174a9cf]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:32 devstack sudo[101112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:20:32 devstack sudo[101112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:32 devstack sudo[101102]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680" returned: 0 in 0.789s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:33 devstack sudo[101116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 Jul 06 21:20:33 devstack sudo[101116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:33 devstack sudo[101112]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 0 in 0.811s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:33 devstack sudo[101121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:20:33 devstack sudo[101121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:33 devstack sudo[101116]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680" returned: 1 in 0.772s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:20:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:33 devstack sudo[101126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680 Jul 06 21:20:33 devstack sudo[101126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:34 devstack sudo[101121]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 1 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.652s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:34 devstack sudo[101126]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-912ee434-3638-4ce8-8481-a5aa10d95680" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-07868091-7571-4204-bb77-84a451b33d01', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd061cae9-b62a-4d8f-812f-8ab8c02eb93d', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Lock "cinder-quobyte-912ee434-3638-4ce8-8481-a5aa10d95680" released by "delete_volume" :: held 2.318s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:20:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-07a19524-f297-4b97-bdfc-fd31771b0752 req-3e6cdb65-ee27-42cd-979f-bdb65246bc57 tempest-TestShelveInstance-1401255239 None] attachment_update completed successfully. Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Created reservations ['20891853-b57b-464c-a3b0-c108e6f5fff5', 'aaf46f37-107d-49d2-97c5-c4316d10b103', 'e3ef849a-de31-438d-a5c4-a8014c573208', 'f51cfad1-e901-4587-babb-0f0306493677'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:34 devstack sudo[101132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:20:34 devstack sudo[101132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:35 devstack sudo[101132]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.648s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:35 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:20:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Deleted volume successfully. Jul 06 21:20:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c498de2-2271-4885-bcb4-34e2a97efe97 tempest-VolumesImageMetadata-1260567873 None] Lock "cinder-912ee434-3638-4ce8-8481-a5aa10d95680-delete_volume" released by "delete_volume" :: held 3.209s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Flow 'volume_create_manager' (bb437af6-c65f-4d26-9ce9-06f28eb167db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbda7ab3-8255-4b9c-b1d9-8f21231f7c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dbda7ab3-8255-4b9c-b1d9-8f21231f7c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1030333172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25d936c-fb93-41e9-9c54-74d62bff7da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864557039e544b59bd535873a4d32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:42Z,use_quota=True,user_id='a0fe68472dfb42cf9a856fc5a2c47d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a575e384-38be-44ee-87d1-fe7aeb65e04b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a575e384-38be-44ee-87d1-fe7aeb65e04b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94c1965-c5d0-4331-aadc-a36a688926fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a94c1965-c5d0-4331-aadc-a36a688926fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd25d936c-fb93-41e9-9c54-74d62bff7da8', 'volume_name': 'volume-d25d936c-fb93-41e9-9c54-74d62bff7da8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10078d86-540f-461c-9a75-df2c177455ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10078d86-540f-461c-9a75-df2c177455ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2563cfeb-1eb9-4f35-a4d3-95a8d216886a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:42 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Volume d25d936c-fb93-41e9-9c54-74d62bff7da8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d25d936c-fb93-41e9-9c54-74d62bff7da8', 'volume_size': 1} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1030333172',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d25d936c-fb93-41e9-9c54-74d62bff7da8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864557039e544b59bd535873a4d32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:42Z,use_quota=True,user_id='a0fe68472dfb42cf9a856fc5a2c47d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Creating volume d25d936c-fb93-41e9-9c54-74d62bff7da8 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:20:42 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:20:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:42 devstack sudo[101584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 1073741824 Jul 06 21:20:42 devstack sudo[101584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:43 devstack sudo[101584]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 1073741824" returned: 0 in 0.960s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:43 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 Jul 06 21:20:43 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:44 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8" returned: 0 in 0.688s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] <== create_volume: return (1702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:20:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.705s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2563cfeb-1eb9-4f35-a4d3-95a8d216886a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d25d936c-fb93-41e9-9c54-74d62bff7da8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcb3cfe-3fb6-4d46-b0eb-90265dc7bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:44 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Volume volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 (d25d936c-fb93-41e9-9c54-74d62bff7da8): created successfully Jul 06 21:20:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dcb3cfe-3fb6-4d46-b0eb-90265dc7bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Flow 'volume_create_manager' (bb437af6-c65f-4d26-9ce9-06f28eb167db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7c55b939-0153-406a-8859-91ec34fc4d1c tempest-VolumesTransfersV355Test-1203208226 None] Created volume successfully. Jul 06 21:20:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a7bcf224-142a-485d-a1c2-48a8e7708531 tempest-VolumesTransfersV355Test-1703370102 None] Transfer volume completed successfully. Jul 06 21:20:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Acquiring lock "cinder-d25d936c-fb93-41e9-9c54-74d62bff7da8-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-d25d936c-fb93-41e9-9c54-74d62bff7da8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Acquiring lock "cinder-quobyte-d25d936c-fb93-41e9-9c54-74d62bff7da8" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-quobyte-d25d936c-fb93-41e9-9c54-74d62bff7da8" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:46 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[62749b58-7bbc-486f-b769-37249c7f3bd9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:46 devstack sudo[101595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 Jul 06 21:20:46 devstack sudo[101595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:47 devstack sudo[101595]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:47 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8 Jul 06 21:20:47 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:47 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d25d936c-fb93-41e9-9c54-74d62bff7da8" returned: 0 in 0.665s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-quobyte-d25d936c-fb93-41e9-9c54-74d62bff7da8" released by "delete_volume" :: held 1.482s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Created reservations ['2a6674b1-2d3d-475c-898d-ab1d8c5602ed', '8dd34d85-f7f2-4774-a649-8a501306242b', 'de155f06-0f00-481c-b73c-d7a6f657b648', '2930069b-5ead-49fe-a107-0dae7d306aaa'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:47 devstack sudo[101603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:20:47 devstack sudo[101603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:48 devstack sudo[101603]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:48 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:20:48 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Deleted volume successfully. Jul 06 21:20:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6eec3053-ce06-48e0-aec5-147ca42bf77d tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-d25d936c-fb93-41e9-9c54-74d62bff7da8-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Flow 'volume_create_manager' (3d58ddd4-b377-4083-9554-bcebdd92248e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f1857e-873d-4a04-ab6f-aef394fd433e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98f1857e-873d-4a04-ab6f-aef394fd433e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1162270468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864557039e544b59bd535873a4d32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:49Z,use_quota=True,user_id='a0fe68472dfb42cf9a856fc5a2c47d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf93f2c-4be5-40ca-917c-b579cdb176b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (baf93f2c-4be5-40ca-917c-b579cdb176b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324bf04d-fb36-42b8-a73f-e6a4e8d1c547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (324bf04d-fb36-42b8-a73f-e6a4e8d1c547) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a', 'volume_name': 'volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea0752-87b2-4901-8e02-9717f5419624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1ea0752-87b2-4901-8e02-9717f5419624) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dd6a53-7fb9-42a1-9a31-9111c505c6f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Volume 71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a', 'volume_size': 1} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:20:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1162270468',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5864557039e544b59bd535873a4d32e4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:20:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:20:49Z,use_quota=True,user_id='a0fe68472dfb42cf9a856fc5a2c47d36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Creating volume 71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:20:49 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:49 devstack sudo[101644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a 1073741824 Jul 06 21:20:49 devstack sudo[101644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:49 devstack sudo[101644]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a 1073741824" returned: 0 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:50 devstack sudo[101649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a Jul 06 21:20:50 devstack sudo[101649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:50 devstack sudo[101649]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a" returned: 0 in 0.644s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] <== create_volume: return (1512ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.514s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31dd6a53-7fb9-42a1-9a31-9111c505c6f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb548e4-9a1c-4186-a2cb-31c3605765fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:20:50 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Volume volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a (71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a): created successfully Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bb548e4-9a1c-4186-a2cb-31c3605765fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:20:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Flow 'volume_create_manager' (3d58ddd4-b377-4083-9554-bcebdd92248e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:20:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-002df2bf-97b9-4a83-80c2-d1c82dae5d79 tempest-VolumesTransfersV355Test-1203208226 None] Created volume successfully. Jul 06 21:20:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Acquiring lock "cinder-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Acquiring lock "cinder-quobyte-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:20:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-quobyte-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:20:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b865148a-3311-43d4-ad5b-4b98dc7e543c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:20:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:51 devstack sudo[101653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a Jul 06 21:20:51 devstack sudo[101653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:52 devstack sudo[101653]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a" returned: 0 in 0.761s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:52 devstack sudo[101658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a Jul 06 21:20:52 devstack sudo[101658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:52 devstack sudo[101658]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-quobyte-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a" released by "delete_volume" :: held 1.478s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Created reservations ['2b60d7a0-f61f-4d1c-aa58-92cadbf51240', '818f9dbf-8d76-40ce-9d60-87749e974ee7', '6898548d-cb5d-49e0-950f-9199b6d998f0', 'd6856b05-3194-4cdd-865b-8d9e8157c197'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:20:53 devstack sudo[101661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:20:53 devstack sudo[101661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:20:53 devstack sudo[101661]: pam_unix(sudo:session): session closed for user root Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:20:53 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Deleted volume successfully. Jul 06 21:20:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5f3d3c55-f060-44f9-ac62-b64d86e5e87a tempest-VolumesTransfersV355Test-849056312 None] Lock "cinder-71ed5e10-c0ea-4cd7-a657-a0f2ca28b81a-delete_volume" released by "delete_volume" :: held 2.338s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:21:01 devstack sudo[101769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:21:01 devstack sudo[101769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:21:01 devstack sudo[101769]: pam_unix(sudo:session): session closed for user root Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.727s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:21:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:21:03 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=42,cinder:INSERT=24,cinder:UPDATE=46,cinder:DELETE=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:21:03 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=35,cinder:SELECT=46,cinder:INSERT=18,cinder:DELETE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Flow 'volume_create_manager' (f2acb261-48dd-4d19-bef2-f14b39ac2c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a183869-5051-4259-b91d-de1a9c701e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a183869-5051-4259-b91d-de1a9c701e8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1856187871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662672ec-6a15-4b71-8903-9c17c1bfc717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e93bfb5c024accbd91faa1f1da49f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:21:08Z,use_quota=True,user_id='278f61b401674269baf67c9df3b87c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc97998-cf97-4401-a7a9-296b95114511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1dc97998-cf97-4401-a7a9-296b95114511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b031ce19-ba76-4d7a-97f5-5a8c451c65a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b031ce19-ba76-4d7a-97f5-5a8c451c65a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662672ec-6a15-4b71-8903-9c17c1bfc717', 'volume_name': 'volume-662672ec-6a15-4b71-8903-9c17c1bfc717', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f18ea47-4d5a-47b1-920e-00879c09e790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f18ea47-4d5a-47b1-920e-00879c09e790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3699e4-a35a-4efd-92bc-6442033d5469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:21:08 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Volume 662672ec-6a15-4b71-8903-9c17c1bfc717: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662672ec-6a15-4b71-8903-9c17c1bfc717', 'volume_size': 1} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:21:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1856187871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662672ec-6a15-4b71-8903-9c17c1bfc717,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5e93bfb5c024accbd91faa1f1da49f3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:21:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:21:08Z,use_quota=True,user_id='278f61b401674269baf67c9df3b87c76',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Creating volume 662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:21:08 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:21:08 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 1073741824 Jul 06 21:21:08 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:21:08 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Jul 06 21:21:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 1073741824" returned: 0 in 0.819s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:21:09 devstack sudo[101789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:21:09 devstack sudo[101789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:21:09 devstack sudo[101789]: pam_unix(sudo:session): session closed for user root Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.648s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] <== create_volume: return (1508ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.511s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a3699e4-a35a-4efd-92bc-6442033d5469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662672ec-6a15-4b71-8903-9c17c1bfc717', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc30b4-2bbe-48a1-9f05-1cf76021342b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:21:09 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Volume volume-662672ec-6a15-4b71-8903-9c17c1bfc717 (662672ec-6a15-4b71-8903-9c17c1bfc717): created successfully Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bc30b4-2bbe-48a1-9f05-1cf76021342b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:21:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Flow 'volume_create_manager' (f2acb261-48dd-4d19-bef2-f14b39ac2c44) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:21:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f8b8717f-042d-46cc-9aab-0eed580ac74a tempest-VolumesActionsTest-1141500109 None] Created volume successfully. Jul 06 21:21:11 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-99a26205-5ef4-4d13-8aed-9ea4613f29bd req-d5f85a08-981c-46b2-abb1-28b1ba17f4a6 tempest-TestShelveInstance-1401255239 None] Terminate volume connection completed successfully. Jul 06 21:21:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-99a26205-5ef4-4d13-8aed-9ea4613f29bd req-d5f85a08-981c-46b2-abb1-28b1ba17f4a6 tempest-TestShelveInstance-1401255239 None] Deleting attachment d061cae9-b62a-4d8f-812f-8ab8c02eb93d. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:21:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:21:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:21:17 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[02a5cfe8-6912-447e-86e8-9250eb6f8091]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:21:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:21:18 devstack sudo[101840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:21:18 devstack sudo[101840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:21:18 devstack sudo[101840]: pam_unix(sudo:session): session closed for user root Jul 06 21:21:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 0 in 0.773s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:21:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:21:18 devstack sudo[101848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:21:18 devstack sudo[101848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:21:19 devstack sudo[101848]: pam_unix(sudo:session): session closed for user root Jul 06 21:21:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 1 in 0.736s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:21:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:21:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.573s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:21:19 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-07868091-7571-4204-bb77-84a451b33d01', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3fb4fa05-477f-43f3-9afc-7fc13ecf61e6', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:21:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-5ad74bc5-0bb5-4090-a37b-c660d4f786c4 req-12d7b3a7-c943-43cf-bed6-3fc1f5467178 tempest-TestShelveInstance-1401255239 None] attachment_update completed successfully. Jul 06 21:21:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83db1ea1-6e97-4937-9ffb-fb385d9e48ea tempest-VolumesActionsTest-1141500109 None] Acquiring lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717" by "attach_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:21:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83db1ea1-6e97-4937-9ffb-fb385d9e48ea tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717" acquired by "attach_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:21:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-83db1ea1-6e97-4937-9ffb-fb385d9e48ea tempest-VolumesActionsTest-1141500109 None] Attaching volume 662672ec-6a15-4b71-8903-9c17c1bfc717 to instance e0ac1c51-4f22-4590-92c8-ac10c0dc41c0 at mountpoint /dev/vdb on host None. Jul 06 21:21:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-83db1ea1-6e97-4937-9ffb-fb385d9e48ea tempest-VolumesActionsTest-1141500109 None] Attach volume completed successfully. Jul 06 21:21:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83db1ea1-6e97-4937-9ffb-fb385d9e48ea tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717" released by "attach_volume" :: held 0.086s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:21:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b82b1d7c-f00e-4294-bf02-5f79012d98cb tempest-VolumesActionsTest-1141500109 None] Acquiring lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-detach_volume" by "detach_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:21:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b82b1d7c-f00e-4294-bf02-5f79012d98cb tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-detach_volume" acquired by "detach_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:21:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b82b1d7c-f00e-4294-bf02-5f79012d98cb tempest-VolumesActionsTest-1141500109 None] Detaching volume 662672ec-6a15-4b71-8903-9c17c1bfc717 from instance e0ac1c51-4f22-4590-92c8-ac10c0dc41c0. Jul 06 21:21:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b82b1d7c-f00e-4294-bf02-5f79012d98cb tempest-VolumesActionsTest-1141500109 None] Detach volume completed successfully. Jul 06 21:21:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b82b1d7c-f00e-4294-bf02-5f79012d98cb tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-detach_volume" released by "detach_volume" :: held 0.081s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:21:36 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=15,cinder:INSERT=1,cinder:UPDATE=5,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:21:36 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=10,cinder:SELECT=15,cinder:INSERT=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:21:49 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:21:49 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:21:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-40f6268f-cd1b-414f-bb34-3ef995f087e3 tempest-VolumesActionsTest-1141500109 None] Acquiring lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717" by "attach_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:21:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-40f6268f-cd1b-414f-bb34-3ef995f087e3 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717" acquired by "attach_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:21:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-40f6268f-cd1b-414f-bb34-3ef995f087e3 tempest-VolumesActionsTest-1141500109 None] Attaching volume 662672ec-6a15-4b71-8903-9c17c1bfc717 to instance 3b136939-ecf8-4a65-9ea3-f0d0332ea944 at mountpoint /dev/vdb on host None. Jul 06 21:21:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-40f6268f-cd1b-414f-bb34-3ef995f087e3 tempest-VolumesActionsTest-1141500109 None] Attach volume completed successfully. Jul 06 21:21:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-40f6268f-cd1b-414f-bb34-3ef995f087e3 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717" released by "attach_volume" :: held 0.100s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:21:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2decb2aa-bf00-4cd6-8371-692733b3a863 tempest-VolumesActionsTest-1141500109 None] Acquiring lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-detach_volume" by "detach_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:21:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2decb2aa-bf00-4cd6-8371-692733b3a863 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-detach_volume" acquired by "detach_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:21:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2decb2aa-bf00-4cd6-8371-692733b3a863 tempest-VolumesActionsTest-1141500109 None] Detaching volume 662672ec-6a15-4b71-8903-9c17c1bfc717 from instance 3b136939-ecf8-4a65-9ea3-f0d0332ea944. Jul 06 21:21:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2decb2aa-bf00-4cd6-8371-692733b3a863 tempest-VolumesActionsTest-1141500109 None] Detach volume completed successfully. Jul 06 21:21:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2decb2aa-bf00-4cd6-8371-692733b3a863 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-detach_volume" released by "detach_volume" :: held 0.076s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:21:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:21:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:21:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2444799f-be59-4238-a25f-9bf95ab3a0cc]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:21:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:21:59 devstack sudo[102616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:21:59 devstack sudo[102616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-9c57905f-a0bd-46cf-a5a0-dd980e9c92a9 tempest-TestShelveInstance-1401255239 None] Terminate volume connection completed successfully. Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-9c57905f-a0bd-46cf-a5a0-dd980e9c92a9 tempest-TestShelveInstance-1401255239 None] Deleting attachment 3fb4fa05-477f-43f3-9afc-7fc13ecf61e6. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Acquiring lock "cinder-07868091-7571-4204-bb77-84a451b33d01-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:00 devstack sudo[102616]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.769s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Lock "cinder-07868091-7571-4204-bb77-84a451b33d01-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2837a8ae-76e6-47a6-b002-faf10a527411]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Acquiring lock "cinder-quobyte-07868091-7571-4204-bb77-84a451b33d01" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Lock "cinder-quobyte-07868091-7571-4204-bb77-84a451b33d01" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd32316-9608-4621-a23f-f52c3663f690]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:00 devstack sudo[102621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:22:00 devstack sudo[102621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:00 devstack sudo[102622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:22:00 devstack sudo[102622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:01 devstack sudo[102625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:01 devstack sudo[102625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:01 devstack sudo[102621]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.810s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.994ec2dd-df00-4477-98c9-cda1c5536a53f_l_u88t.img {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:01 devstack sudo[102632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.994ec2dd-df00-4477-98c9-cda1c5536a53f_l_u88t.img Jul 06 21:22:01 devstack sudo[102632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:01 devstack sudo[102622]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 0 in 0.832s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:01 devstack sudo[102634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:22:01 devstack sudo[102634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:01 devstack sudo[102625]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.715s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:22:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:22:02 devstack sudo[102634]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 1 in 1.113s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:22:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:02 devstack sudo[102650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01 Jul 06 21:22:02 devstack sudo[102650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:04 devstack sudo[102650]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-07868091-7571-4204-bb77-84a451b33d01" returned: 0 in 1.312s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Lock "cinder-quobyte-07868091-7571-4204-bb77-84a451b33d01" released by "delete_volume" :: held 3.348s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG cinder.quota [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Created reservations ['26d0c52f-c386-4ae0-9432-398dbef6d250', '5d536b43-4d3f-49e1-92c2-c06528be190c', '35a1aec6-44b3-4080-a9da-8ea8ef456aaf', '518fbf7f-fd95-422b-9380-8882a8b618ea'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:04 devstack sudo[102654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:04 devstack sudo[102654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:05 devstack sudo[102654]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.512s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:05 devstack cinder-volume[87273]: DEBUG cinder.manager [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:22:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Deleted volume successfully. Jul 06 21:22:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [req-e03a5540-6c21-408e-982a-6f478dc7e81c req-b89dce2f-b8e7-43c1-9a0f-c92f6f8230bb tempest-TestShelveInstance-1401255239 None] Lock "cinder-07868091-7571-4204-bb77-84a451b33d01-delete_volume" released by "delete_volume" :: held 5.362s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:06 devstack sudo[102632]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.994ec2dd-df00-4477-98c9-cda1c5536a53f_l_u88t.img" returned: 0 in 5.379s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:06 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b4f622a-44f5-4934-9786-e69a531ebdcc]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:06 devstack sudo[102657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:22:06 devstack sudo[102657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:07 devstack sudo[102657]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.997s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:07 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717, size 1024.00 MB, duration 5.38 sec, destination /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.994ec2dd-df00-4477-98c9-cda1c5536a53f_l_u88t.img {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:22:07 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Converted 1024.00 MB image at 190.35 MB/s Jul 06 21:22:07 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] 994ec2dd-df00-4477-98c9-cda1c5536a53 was raw, no need to convert to raw {{(pid=87273) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (9d0a8491-db7b-410d-9bdd-638e56f9975c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef607c59-6933-48eb-b00c-1fca86d510d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef607c59-6933-48eb-b00c-1fca86d510d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324146689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471ae0a2-67d4-435a-9c22-e1aa467f144c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:17Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade6f923-14c3-4753-9ac8-b18374913543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade6f923-14c3-4753-9ac8-b18374913543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bff6f38-dd72-4337-ad01-52f3fdf2a7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3bff6f38-dd72-4337-ad01-52f3fdf2a7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '471ae0a2-67d4-435a-9c22-e1aa467f144c', 'volume_name': 'volume-471ae0a2-67d4-435a-9c22-e1aa467f144c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2efcf6-ceb7-4ec0-8b3f-d27dc57bc157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e2efcf6-ceb7-4ec0-8b3f-d27dc57bc157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ff85cb-60b8-4aa6-ac99-2ca995b156e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:17 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume 471ae0a2-67d4-435a-9c22-e1aa467f144c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-471ae0a2-67d4-435a-9c22-e1aa467f144c', 'volume_size': 1} Jul 06 21:22:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:26 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=10,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:22:26 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=13 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.543s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Uploaded volume to glance image-id: 994ec2dd-df00-4477-98c9-cda1c5536a53. {{(pid=87273) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.391s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-324146689',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=471ae0a2-67d4-435a-9c22-e1aa467f144c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:17Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Creating volume 471ae0a2-67d4-435a-9c22-e1aa467f144c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:22:27 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:22:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:27 devstack sudo[102668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c 1073741824 Jul 06 21:22:27 devstack sudo[102668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6ef43272-bab0-48dd-aa37-abe4e559730f tempest-VolumesActionsTest-1141500109 None] Copy volume to image completed successfully. Jul 06 21:22:28 devstack sudo[102668]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c 1073741824" returned: 0 in 0.849s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:28 devstack sudo[102674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c Jul 06 21:22:28 devstack sudo[102674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:28 devstack sudo[102674]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c" returned: 0 in 0.642s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.541s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83ff85cb-60b8-4aa6-ac99-2ca995b156e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-471ae0a2-67d4-435a-9c22-e1aa467f144c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff681ad-8d33-4b2d-afc3-e2f06d2ca4f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume volume-471ae0a2-67d4-435a-9c22-e1aa467f144c (471ae0a2-67d4-435a-9c22-e1aa467f144c): created successfully Jul 06 21:22:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cff681ad-8d33-4b2d-afc3-e2f06d2ca4f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:29 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (9d0a8491-db7b-410d-9bdd-638e56f9975c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb194e46-14c3-410a-b7e8-8262155f52ab]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:29 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-173d18b6-5ac0-4d5f-bf02-a67dd7095633 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created volume successfully. Jul 06 21:22:29 devstack sudo[102678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:22:29 devstack sudo[102678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:29 devstack sudo[102678]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.762s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[53c88070-47d7-410a-875f-0b6787114f24]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:29 devstack sudo[102683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:22:29 devstack sudo[102683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (7741ae7f-0f8b-4027-9c45-56bb92dda51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c00ed9c-1d5a-4434-9760-4dac9c5a7bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c00ed9c-1d5a-4434-9760-4dac9c5a7bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009370272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed6730-5c90-43a2-8ca4-0fe7f5924874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:30Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57215225-b21d-4e71-ba36-b08f7433d162) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57215225-b21d-4e71-ba36-b08f7433d162) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c85f54-7a54-4e5a-9861-775959ae2283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13c85f54-7a54-4e5a-9861-775959ae2283) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92ed6730-5c90-43a2-8ca4-0fe7f5924874', 'volume_name': 'volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5604bff5-cd92-47d1-9a06-05384aedf706) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5604bff5-cd92-47d1-9a06-05384aedf706) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384a3bc6-e607-433f-a7a9-ca50846f80a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume 92ed6730-5c90-43a2-8ca4-0fe7f5924874: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874', 'volume_size': 1} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (e511adf6-ed83-47e6-8f89-560f99b3c01f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f627c30-9174-489b-9223-6abf74c9d3a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f627c30-9174-489b-9223-6abf74c9d3a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522020941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7a3948-7606-4e70-8a88-cb3a3e1b570c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:30Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a590f74b-7acd-4afe-a5ff-06b22f4f6f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a590f74b-7acd-4afe-a5ff-06b22f4f6f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d231901b-ff01-4901-8034-0f8086c7444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d231901b-ff01-4901-8034-0f8086c7444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b7a3948-7606-4e70-8a88-cb3a3e1b570c', 'volume_name': 'volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353ea846-41ce-4599-849c-986ce49fa3bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (353ea846-41ce-4599-849c-986ce49fa3bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa90080-69db-4eb9-a26b-fb8b76ffda6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume 5b7a3948-7606-4e70-8a88-cb3a3e1b570c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c', 'volume_size': 1} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:30 devstack sudo[102683]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.802s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:30 devstack sudo[102688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img Jul 06 21:22:30 devstack sudo[102688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (32ce99b8-a02d-4c4b-9d48-c6608263ec14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588707e3-cb26-43b7-bd72-35b23473ef4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (588707e3-cb26-43b7-bd72-35b23473ef4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707692442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ed66c6-5713-42bf-ba87-e671ce6dc9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:31Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f597e6cf-96b1-4d24-84a7-a2e1688b35d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f597e6cf-96b1-4d24-84a7-a2e1688b35d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046dd314-b618-41eb-8695-9eec98ff444e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046dd314-b618-41eb-8695-9eec98ff444e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5ed66c6-5713-42bf-ba87-e671ce6dc9b8', 'volume_name': 'volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469e75b1-917b-42b2-bda5-c19939d42086) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (469e75b1-917b-42b2-bda5-c19939d42086) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac3790a-7ef6-4994-b831-bff0c486aaa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume a5ed66c6-5713-42bf-ba87-e671ce6dc9b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8', 'volume_size': 1} Jul 06 21:22:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (9e8b7e52-bf91-41a5-9df2-e7c7dd5363cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5f2f13-d401-4255-b32e-5c2e0c623a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5f2f13-d401-4255-b32e-5c2e0c623a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261417165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c5abeb-fe68-4481-864b-b2e129c2de51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:31Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4aeb7f-b0db-4e26-886d-71773593ec45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a4aeb7f-b0db-4e26-886d-71773593ec45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599c8019-ff45-44fa-a49c-720ed5399d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (599c8019-ff45-44fa-a49c-720ed5399d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73c5abeb-fe68-4481-864b-b2e129c2de51', 'volume_name': 'volume-73c5abeb-fe68-4481-864b-b2e129c2de51', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e158d52e-5f93-4a5c-abc1-c8f405aaf4bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e158d52e-5f93-4a5c-abc1-c8f405aaf4bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2cc804-5f7c-4466-9831-dbb1a33b4ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume 73c5abeb-fe68-4481-864b-b2e129c2de51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73c5abeb-fe68-4481-864b-b2e129c2de51', 'volume_size': 1} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (6f03ec34-a6a9-4043-a374-eeed2498df0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d627c6d7-24af-4dcf-805e-6f096b05562a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d627c6d7-24af-4dcf-805e-6f096b05562a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765567837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac948c43-9537-4c3e-b258-8ea67d84a773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:32Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a12fdd-12de-4354-bb43-d1682c9b37f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82a12fdd-12de-4354-bb43-d1682c9b37f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fa3013-87d4-4f53-9528-80df39d77c1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43fa3013-87d4-4f53-9528-80df39d77c1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac948c43-9537-4c3e-b258-8ea67d84a773', 'volume_name': 'volume-ac948c43-9537-4c3e-b258-8ea67d84a773', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668f39de-e407-426f-9bab-eae755887dbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (668f39de-e407-426f-9bab-eae755887dbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23746724-eb2a-44f1-b014-daffe6e19cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:31 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume ac948c43-9537-4c3e-b258-8ea67d84a773: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac948c43-9537-4c3e-b258-8ea67d84a773', 'volume_size': 1} Jul 06 21:22:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:35 devstack sudo[102688]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img" returned: 0 in 4.512s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:35 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5298da56-293e-40a1-982f-ab223775df13]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:35 devstack sudo[102701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:22:35 devstack sudo[102701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:36 devstack sudo[102701]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.908s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:36 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717, size 1024.00 MB, duration 4.51 sec, destination /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:22:36 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Converted 1024.00 MB image at 226.90 MB/s Jul 06 21:22:36 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] 8b2d70b9-1177-46d5-8b99-eedccd01207d was raw, converting to qcow2 {{(pid=87273) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Jul 06 21:22:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a844aad-008c-4578-9408-8b32f41bd7d7]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:36 devstack sudo[102708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img Jul 06 21:22:36 devstack sudo[102708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:36 devstack sudo[102708]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img" returned: 0 in 0.700s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:36 devstack sudo[102712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img Jul 06 21:22:36 devstack sudo[102712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:37 devstack sudo[102712]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img" returned: 1 in 0.720s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:22:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img /opt/stack/data/cinder/conversion/vol_upload_ljbm48nl {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:37 devstack sudo[102717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img /opt/stack/data/cinder/conversion/vol_upload_ljbm48nl Jul 06 21:22:37 devstack sudo[102717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:38 devstack sudo[102717]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img /opt/stack/data/cinder/conversion/vol_upload_ljbm48nl" returned: 0 in 0.627s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:38 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Image conversion details: src /opt/stack/data/cinder/conversion/662672ec-6a15-4b71-8903-9c17c1bfc717.temp_image.8b2d70b9-1177-46d5-8b99-eedccd01207djq7kkbwn.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_ljbm48nl {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:22:38 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Converted 1024.00 MB image at 1024.00 MB/s Jul 06 21:22:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f9d836c-ee24-461b-8d72-4c565139da41]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ljbm48nl {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:38 devstack sudo[102722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ljbm48nl Jul 06 21:22:38 devstack sudo[102722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:38 devstack sudo[102722]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_ljbm48nl" returned: 0 in 0.734s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 11.104s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Uploaded volume to glance image-id: 8b2d70b9-1177-46d5-8b99-eedccd01207d. {{(pid=87273) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.852s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1009370272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92ed6730-5c90-43a2-8ca4-0fe7f5924874,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:30Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Creating volume 92ed6730-5c90-43a2-8ca4-0fe7f5924874 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:22:40 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:40 devstack sudo[102728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 1073741824 Jul 06 21:22:40 devstack sudo[102728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:40 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-08011d98-fb73-4e07-8f79-443dcfa47a3f tempest-VolumesActionsTest-1141500109 None] Copy volume to image completed successfully. Jul 06 21:22:40 devstack sudo[102728]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 1073741824" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:40 devstack sudo[102734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 Jul 06 21:22:40 devstack sudo[102734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Acquiring lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Acquiring lock "cinder-quobyte-662672ec-6a15-4b71-8903-9c17c1bfc717" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-quobyte-662672ec-6a15-4b71-8903-9c17c1bfc717" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[df641b72-add2-449f-8ebc-c1a853ae0bf0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:41 devstack sudo[102736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:22:41 devstack sudo[102736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:41 devstack sudo[102734]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874" returned: 0 in 0.659s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] <== create_volume: return (1534ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.537s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.051s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-522020941',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b7a3948-7606-4e70-8a88-cb3a3e1b570c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:30Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Creating volume 5b7a3948-7606-4e70-8a88-cb3a3e1b570c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:22:41 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:41 devstack sudo[102739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c 1073741824 Jul 06 21:22:41 devstack sudo[102739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (384a3bc6-e607-433f-a7a9-ca50846f80a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be42f0b5-9373-4061-b595-2d330f7754a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:41 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 (92ed6730-5c90-43a2-8ca4-0fe7f5924874): created successfully Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be42f0b5-9373-4061-b595-2d330f7754a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (7741ae7f-0f8b-4027-9c45-56bb92dda51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ca6165de-40e6-4dea-8115-7a8d34edb99a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created volume successfully. Jul 06 21:22:41 devstack sudo[102736]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.772s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:41 devstack sudo[102744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717 Jul 06 21:22:41 devstack sudo[102744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:42 devstack sudo[102739]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c 1073741824" returned: 0 in 0.831s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:42 devstack sudo[102749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c Jul 06 21:22:42 devstack sudo[102749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:42 devstack sudo[102744]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-662672ec-6a15-4b71-8903-9c17c1bfc717" returned: 0 in 0.701s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-quobyte-662672ec-6a15-4b71-8903-9c17c1bfc717" released by "delete_volume" :: held 1.512s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Created reservations ['976e99d9-9ed4-4f4f-a1d4-ce94a800a151', 'af9f920b-de83-4f0d-a20c-f768b96caca2', '46ec1f48-dfa4-4378-809f-76b354f69eb2', '45c51d79-dc20-4943-8ca3-103192642dac'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:42 devstack sudo[102752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:42 devstack sudo[102752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:43 devstack sudo[102749]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c" returned: 0 in 0.660s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] <== create_volume: return (1528ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.531s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.249s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-707692442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5ed66c6-5713-42bf-ba87-e671ce6dc9b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:31Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Creating volume a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:22:43 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:43 devstack sudo[102755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 1073741824 Jul 06 21:22:43 devstack sudo[102755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (faa90080-69db-4eb9-a26b-fb8b76ffda6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16293bcb-07a4-4684-a085-e89cf238bb3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:43 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c (5b7a3948-7606-4e70-8a88-cb3a3e1b570c): created successfully Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16293bcb-07a4-4684-a085-e89cf238bb3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (e511adf6-ed83-47e6-8f89-560f99b3c01f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-04a57e6c-b570-4f2a-89cb-eae3c75ce18e tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created volume successfully. Jul 06 21:22:43 devstack sudo[102752]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.678s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:22:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Deleted volume successfully. Jul 06 21:22:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5d55d3fb-fca8-42d2-ac40-aa7ffb2137a3 tempest-VolumesActionsTest-1141500109 None] Lock "cinder-662672ec-6a15-4b71-8903-9c17c1bfc717-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:44 devstack sudo[102755]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 1073741824" returned: 0 in 0.907s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:44 devstack sudo[102762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 Jul 06 21:22:44 devstack sudo[102762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:44 devstack sudo[102762]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8" returned: 0 in 0.703s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.566s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-261417165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73c5abeb-fe68-4481-864b-b2e129c2de51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:31Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Creating volume 73c5abeb-fe68-4481-864b-b2e129c2de51 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:22:44 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9ac3790a-7ef6-4994-b831-bff0c486aaa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:44 devstack sudo[102766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 1073741824 Jul 06 21:22:44 devstack sudo[102766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b951051c-49bd-4424-8111-c3853f31fdb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:44 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 (a5ed66c6-5713-42bf-ba87-e671ce6dc9b8): created successfully Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b951051c-49bd-4424-8111-c3853f31fdb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (32ce99b8-a02d-4c4b-9d48-c6608263ec14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c089c58f-395e-4b88-82f3-98d20765e97b tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created volume successfully. Jul 06 21:22:45 devstack sudo[102766]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 1073741824" returned: 0 in 0.919s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:45 devstack sudo[102771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 Jul 06 21:22:45 devstack sudo[102771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:46 devstack sudo[102771]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51" returned: 0 in 0.742s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] <== create_volume: return (1708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.714s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.609s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-765567837',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac948c43-9537-4c3e-b258-8ea67d84a773,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d259d9dbd4fd439ab4393a9c45ef23ff',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:32Z,use_quota=True,user_id='9a6524748d27497aacb679905f404543',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Creating volume ac948c43-9537-4c3e-b258-8ea67d84a773 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:22:46 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc2cc804-5f7c-4466-9831-dbb1a33b4ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73c5abeb-fe68-4481-864b-b2e129c2de51', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:46 devstack sudo[102774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 1073741824 Jul 06 21:22:46 devstack sudo[102774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb5f51-b149-4678-a95f-c152a7429af7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:46 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume volume-73c5abeb-fe68-4481-864b-b2e129c2de51 (73c5abeb-fe68-4481-864b-b2e129c2de51): created successfully Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (67eb5f51-b149-4678-a95f-c152a7429af7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (9e8b7e52-bf91-41a5-9df2-e7c7dd5363cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-646d5f17-f0de-473d-b388-03aa6afae9f9 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created volume successfully. Jul 06 21:22:47 devstack sudo[102774]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 1073741824" returned: 0 in 0.919s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:47 devstack sudo[102781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 Jul 06 21:22:47 devstack sudo[102781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:48 devstack sudo[102781]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773" returned: 0 in 0.684s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:22:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.656s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23746724-eb2a-44f1-b014-daffe6e19cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac948c43-9537-4c3e-b258-8ea67d84a773', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a05461-24cf-4b47-ba7b-715b01074d1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:48 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Volume volume-ac948c43-9537-4c3e-b258-8ea67d84a773 (ac948c43-9537-4c3e-b258-8ea67d84a773): created successfully Jul 06 21:22:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30a05461-24cf-4b47-ba7b-715b01074d1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Flow 'volume_create_manager' (6f03ec34-a6a9-4043-a374-eeed2498df0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:48 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bff5a02d-f843-4e21-9435-ed7ea5fa0462 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created volume successfully. Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-ac948c43-9537-4c3e-b258-8ea67d84a773-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-ac948c43-9537-4c3e-b258-8ea67d84a773-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-quobyte-ac948c43-9537-4c3e-b258-8ea67d84a773" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-ac948c43-9537-4c3e-b258-8ea67d84a773" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d375834f-1fd1-4aa1-8dcb-b37c9c41e882]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:22:49 devstack sudo[102786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 Jul 06 21:22:49 devstack sudo[102786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Flow 'volume_create_manager' (a0a68719-29b9-40f6-b959-2a41cd3267d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143a278e-9188-4ed5-b8f2-db165334bed4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (143a278e-9188-4ed5-b8f2-db165334bed4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-654811493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703a6e95-6398-450a-ac24-f32d5431d734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90bbac5cff24b0b80905c2cd0ab922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:49Z,use_quota=True,user_id='e6b8d5aaaa1d404ebc4a41d06bed65c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6122fa56-2dcb-4438-8dcc-b7e059c238c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6122fa56-2dcb-4438-8dcc-b7e059c238c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0b89c5-2382-4c3b-a47c-ec3f548988f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e0b89c5-2382-4c3b-a47c-ec3f548988f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '703a6e95-6398-450a-ac24-f32d5431d734', 'volume_name': 'volume-703a6e95-6398-450a-ac24-f32d5431d734', 'volume_size': 2}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9646c5-297c-4639-b9df-c70610ff77bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb9646c5-297c-4639-b9df-c70610ff77bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92731b0-90e8-44a3-ac9f-e14a2b4c0587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Volume 703a6e95-6398-450a-ac24-f32d5431d734: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-703a6e95-6398-450a-ac24-f32d5431d734', 'volume_size': 2} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:22:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-654811493',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=703a6e95-6398-450a-ac24-f32d5431d734,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d90bbac5cff24b0b80905c2cd0ab922b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:22:49Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:22:49Z,use_quota=True,user_id='e6b8d5aaaa1d404ebc4a41d06bed65c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Creating volume 703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:22:49 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:22:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 2147483648 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:49 devstack sudo[102821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 2147483648 Jul 06 21:22:49 devstack sudo[102821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:50 devstack sudo[102786]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:50 devstack sudo[102833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773 Jul 06 21:22:50 devstack sudo[102833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:50 devstack sudo[102821]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 2147483648" returned: 0 in 0.982s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:50 devstack sudo[102836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 Jul 06 21:22:50 devstack sudo[102836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:50 devstack sudo[102833]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac948c43-9537-4c3e-b258-8ea67d84a773" returned: 0 in 0.698s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-ac948c43-9537-4c3e-b258-8ea67d84a773" released by "delete_volume" :: held 1.559s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created reservations ['68ef79a8-b42f-46ed-a753-3648ac108ff1', 'cee944f2-167c-4426-a857-542c50dbd78d', 'bfda7b20-640f-482e-8b4b-1d2edce809ab', '81ad0f17-6e07-4a52-a2bd-890b8d0d5665'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:50 devstack sudo[102839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:50 devstack sudo[102839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:51 devstack sudo[102836]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734" returned: 0 in 0.658s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] <== create_volume: return (1688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.690s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e92731b0-90e8-44a3-ac9f-e14a2b4c0587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-703a6e95-6398-450a-ac24-f32d5431d734', 'volume_size': 2}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c81bbe-d397-478c-b5d4-07f3b7855b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:22:51 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Volume volume-703a6e95-6398-450a-ac24-f32d5431d734 (703a6e95-6398-450a-ac24-f32d5431d734): created successfully Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (97c81bbe-d397-478c-b5d4-07f3b7855b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Flow 'volume_create_manager' (a0a68719-29b9-40f6-b959-2a41cd3267d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:22:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-545e0427-4f4e-4027-9527-0f8fc611b695 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Created volume successfully. Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-73c5abeb-fe68-4481-864b-b2e129c2de51-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-73c5abeb-fe68-4481-864b-b2e129c2de51-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-quobyte-73c5abeb-fe68-4481-864b-b2e129c2de51" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-73c5abeb-fe68-4481-864b-b2e129c2de51" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[68866295-0efc-4504-a16c-21c4aece81ce]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:51 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 Jul 06 21:22:51 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Creating offline snapshot fc2ee2cb-c8cc-46d8-b250-6073722c864b of volume 703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:22:51 devstack sudo[102839]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.738s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:22:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Deleted volume successfully. Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2cb27ce-9a87-4535-8b35-ef7203141ad4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b8efd7cb-b400-44d5-99bc-07a80cc2216f tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-ac948c43-9537-4c3e-b258-8ea67d84a773-delete_volume" released by "delete_volume" :: held 2.555s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:51 devstack sudo[102845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 Jul 06 21:22:51 devstack sudo[102845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:52 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51" returned: 0 in 0.809s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:52 devstack sudo[102851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51 Jul 06 21:22:52 devstack sudo[102851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:52 devstack sudo[102845]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734" returned: 0 in 0.793s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b 2G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:52 devstack sudo[102856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b 2G Jul 06 21:22:52 devstack sudo[102856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:53 devstack sudo[102851]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-73c5abeb-fe68-4481-864b-b2e129c2de51" returned: 0 in 0.677s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-73c5abeb-fe68-4481-864b-b2e129c2de51" released by "delete_volume" :: held 1.545s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created reservations ['7e30a4b1-a2d3-497b-b61d-4aead4bbb8a1', 'b1cdc991-65c9-46cd-8673-c0ae9c7093f6', '44be1c55-2e6a-420e-b006-fff160de1915', '8599bc43-86ba-4a6d-8341-21ed75dd53dd'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:53 devstack sudo[102862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:53 devstack sudo[102862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:53 devstack sudo[102856]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b 2G" returned: 0 in 0.791s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-703a6e95-6398-450a-ac24-f32d5431d734 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:53 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-703a6e95-6398-450a-ac24-f32d5431d734 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b Jul 06 21:22:53 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-quobyte-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac17f9f6-94e6-4fcf-ad1b-08de398e44c3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:53 devstack sudo[102862]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.676s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:22:53 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Deleted volume successfully. Jul 06 21:22:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2c8d5d47-900d-4e33-a6bd-3c8b6b564796 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-73c5abeb-fe68-4481-864b-b2e129c2de51-delete_volume" released by "delete_volume" :: held 2.446s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:53 devstack sudo[102868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 Jul 06 21:22:53 devstack sudo[102868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:54 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-703a6e95-6398-450a-ac24-f32d5431d734 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b" returned: 0 in 0.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:54 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b is being set with open permissions: ugo+rw Jul 06 21:22:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:54 devstack sudo[102873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b Jul 06 21:22:54 devstack sudo[102873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:54 devstack sudo[102868]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8" returned: 0 in 0.778s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:54 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8 Jul 06 21:22:54 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:54 devstack sudo[102873]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b" returned: 0 in 0.658s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:54 devstack sudo[102881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.info Jul 06 21:22:54 devstack sudo[102881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:55 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8" released by "delete_volume" :: held 1.472s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created reservations ['0d81833c-663a-46fb-aa0a-bfcb91c36650', 'dee3a9df-8fc4-47f3-a2ff-e316864b5ab6', 'af9c3801-51af-424a-bc6b-273cd765867f', '040d59b5-10f1-4b8c-af1f-5cb677da37d6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:55 devstack sudo[102881]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.info" returned: 0 in 0.662s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:55 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.info is being set with open permissions: ugo+rw Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:55 devstack sudo[102885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:55 devstack sudo[102885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:55 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.info Jul 06 21:22:55 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-5b7a3948-7606-4e70-8a88-cb3a3e1b570c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-5b7a3948-7606-4e70-8a88-cb3a3e1b570c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-quobyte-5b7a3948-7606-4e70-8a88-cb3a3e1b570c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:55 devstack sudo[102885]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.641s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:22:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Deleted volume successfully. Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-5b7a3948-7606-4e70-8a88-cb3a3e1b570c" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:56 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.info" returned: 0 in 0.666s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.398s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[033af5fc-1761-461b-a09d-df36652dfc28]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-20a66984-73b5-4d27-b381-5bb22a70ea48 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-a5ed66c6-5713-42bf-ba87-e671ce6dc9b8-delete_volume" released by "delete_volume" :: held 2.377s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0376d337-169f-412a-8814-f1a60a6bd47b tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Create snapshot completed successfully Jul 06 21:22:56 devstack sudo[102892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c Jul 06 21:22:56 devstack sudo[102892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:56 devstack sudo[102892]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c" returned: 0 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:56 devstack sudo[102903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c Jul 06 21:22:56 devstack sudo[102903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "cinder-fc2ee2cb-c8cc-46d8-b250-6073722c864b-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-fc2ee2cb-c8cc-46d8-b250-6073722c864b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "cinder-quobyte-703a6e95-6398-450a-ac24-f32d5431d734" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-quobyte-703a6e95-6398-450a-ac24-f32d5431d734" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "cinder-quobyte-fc2ee2cb-c8cc-46d8-b250-6073722c864b" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-quobyte-fc2ee2cb-c8cc-46d8-b250-6073722c864b" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Deleting offline snapshot fc2ee2cb-c8cc-46d8-b250-6073722c864b of volume 703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] snapshot_file for this snap is: volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[24a37015-4061-48b3-a9b7-cb010a4891d8]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:57 devstack sudo[102905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b Jul 06 21:22:57 devstack sudo[102905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:57 devstack sudo[102903]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5b7a3948-7606-4e70-8a88-cb3a3e1b570c" returned: 0 in 0.671s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-5b7a3948-7606-4e70-8a88-cb3a3e1b570c" released by "delete_volume" :: held 1.468s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created reservations ['ab1c1b0a-e88c-4b07-b674-33e8d269cfaa', '0f53d5e4-f04b-4f2b-953a-32a866d0c9ba', '61ee5ed0-f9d2-49d2-a4c5-e6c702aa07a2', 'f0f25585-cfa0-402a-a179-2c5d9a0f9cc3'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:57 devstack sudo[102908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:57 devstack sudo[102908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:57 devstack sudo[102905]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b" returned: 0 in 0.767s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-703a6e95-6398-450a-ac24-f32d5431d734(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a9741389-ac97-4fd8-9de0-2c181138d41c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:57 devstack sudo[102913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 Jul 06 21:22:57 devstack sudo[102913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-92ed6730-5c90-43a2-8ca4-0fe7f5924874-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-92ed6730-5c90-43a2-8ca4-0fe7f5924874-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-quobyte-92ed6730-5c90-43a2-8ca4-0fe7f5924874" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:22:58 devstack sudo[102908]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-92ed6730-5c90-43a2-8ca4-0fe7f5924874" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:22:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Deleted volume successfully. Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[810ff9ca-155b-4d93-95ca-6d144011d4d0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fac80249-6314-4ee3-9573-c76a029bb335 tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-5b7a3948-7606-4e70-8a88-cb3a3e1b570c-delete_volume" released by "delete_volume" :: held 2.399s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:58 devstack sudo[102917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 Jul 06 21:22:58 devstack sudo[102917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:58 devstack sudo[102913]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734" returned: 0 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:58 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b Jul 06 21:22:58 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:59 devstack sudo[102917]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874" returned: 0 in 0.778s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:59 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874 Jul 06 21:22:59 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:59 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b" returned: 0 in 0.752s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:59 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b Jul 06 21:22:59 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:22:59 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-92ed6730-5c90-43a2-8ca4-0fe7f5924874" returned: 0 in 0.660s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-92ed6730-5c90-43a2-8ca4-0fe7f5924874" released by "delete_volume" :: held 1.496s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created reservations ['3510e913-5916-4c67-b325-8656526c8841', 'a29a15a5-65ae-4f34-8e14-d62600e09a96', 'cdc900ad-849f-4ee1-a9dc-ac928ccf41f3', '08a1816a-9bd3-4eb4-9480-c77c97453fa9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:22:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:22:59 devstack sudo[102939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:22:59 devstack sudo[102939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:00 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734.fc2ee2cb-c8cc-46d8-b250-6073722c864b" returned: 0 in 0.641s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-quobyte-fc2ee2cb-c8cc-46d8-b250-6073722c864b" released by "_delete_snapshot" :: held 3.075s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-quobyte-703a6e95-6398-450a-ac24-f32d5431d734" released by "delete_snapshot" :: held 3.105s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Created reservations ['8d3e997f-e2ea-47fb-815d-fbc2a9c883cb', '6cce7a4a-e3bb-42bb-82cc-eb8b6c8289df', '925857cf-8f77-424f-a221-cda278b5f668', '6b86f836-fd0a-419e-8564-50f7e3125344'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:23:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Delete snapshot completed successfully. Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de8db992-5245-4414-97f9-b40a882801be tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-fc2ee2cb-c8cc-46d8-b250-6073722c864b-delete_snapshot" released by "delete_snapshot" :: held 3.236s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-471ae0a2-67d4-435a-9c22-e1aa467f144c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-471ae0a2-67d4-435a-9c22-e1aa467f144c-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "cinder-quobyte-471ae0a2-67d4-435a-9c22-e1aa467f144c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-471ae0a2-67d4-435a-9c22-e1aa467f144c" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e206cd55-0028-4a83-87a8-9a39f56a4c9a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:00 devstack sudo[102939]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:23:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Deleted volume successfully. Jul 06 21:23:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-087a568d-2d6f-4237-b878-cfd2b06ab80a tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-92ed6730-5c90-43a2-8ca4-0fe7f5924874-delete_volume" released by "delete_volume" :: held 2.387s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:00 devstack sudo[102943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c Jul 06 21:23:00 devstack sudo[102943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:01 devstack sudo[102946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:23:01 devstack sudo[102946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "cinder-703a6e95-6398-450a-ac24-f32d5431d734-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-703a6e95-6398-450a-ac24-f32d5431d734-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:01 devstack sudo[102943]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:01 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c Jul 06 21:23:01 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "cinder-quobyte-703a6e95-6398-450a-ac24-f32d5431d734" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-quobyte-703a6e95-6398-450a-ac24-f32d5431d734" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[61a3d9c4-6978-4000-be3e-dde5b3f7960d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:01 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 Jul 06 21:23:01 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:01 devstack sudo[102946]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.716s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:23:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:23:02 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-471ae0a2-67d4-435a-9c22-e1aa467f144c" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-quobyte-471ae0a2-67d4-435a-9c22-e1aa467f144c" released by "delete_volume" :: held 1.531s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Created reservations ['007c6bb9-cb7f-401c-8538-61cc72b47624', 'c39c5fc7-1a84-450c-aa19-1df90cc731b5', '0a20caea-be46-48d0-b7e9-d92e5e1034fa', 'a682be51-992e-46ae-b0c2-d5ceca3a0ac2'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:02 devstack sudo[102959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:23:02 devstack sudo[102959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:02 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734" returned: 0 in 0.775s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:02 devstack sudo[102961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734 Jul 06 21:23:02 devstack sudo[102961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:02 devstack sudo[102959]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.654s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:23:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Deleted volume successfully. Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d6bd17b4-17b4-40b9-94c9-dac0c96abdea tempest-CreateVolumesFromSourceVolumeTest-847132838 None] Lock "cinder-471ae0a2-67d4-435a-9c22-e1aa467f144c-delete_volume" released by "delete_volume" :: held 2.401s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:02 devstack sudo[102961]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-703a6e95-6398-450a-ac24-f32d5431d734" returned: 0 in 0.700s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-quobyte-703a6e95-6398-450a-ac24-f32d5431d734" released by "delete_volume" :: held 1.531s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:02 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Created reservations ['6ea417b0-6f25-4cb1-affc-af8d9ed6c911', '1cefc85b-1aa5-48e8-8fd4-c662a103ec7d', '55f40fc1-82bf-437a-8104-3a617870e907', '5e7d03bc-1e91-4793-83f7-04db1bdecfad'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:03 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:23:03 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:03 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.730s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:23:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Deleted volume successfully. Jul 06 21:23:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-becf1206-a1a1-48e6-a6a4-a223a870ebd3 tempest-VolumesSnapshotNegativeTestJSON-1029140219 None] Lock "cinder-703a6e95-6398-450a-ac24-f32d5431d734-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Flow 'volume_create_manager' (69d30609-a648-4cdf-a510-e250838ce661) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c6ffd6-f807-4b9b-a95c-d50a927bc593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70c6ffd6-f807-4b9b-a95c-d50a927bc593) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2077452217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9984c69d-ba75-45f2-a16d-b953d3bb2a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43a157cb9584ca5ab77f503a638a98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:06Z,use_quota=True,user_id='cb366bcdaf5f422ab5506b6d72edcd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab21cfea-5e7d-4017-9444-6ab23dcca476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab21cfea-5e7d-4017-9444-6ab23dcca476) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c43f6ef-b462-4377-9bbd-3d1d2bee6595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c43f6ef-b462-4377-9bbd-3d1d2bee6595) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9984c69d-ba75-45f2-a16d-b953d3bb2a02', 'volume_name': 'volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa6c630-7b25-4a95-9cf4-42d31e5df10f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faa6c630-7b25-4a95-9cf4-42d31e5df10f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b827bf2d-dd9c-46c4-8dca-416cffa207eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:05 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Volume 9984c69d-ba75-45f2-a16d-b953d3bb2a02: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02', 'volume_size': 1} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2077452217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9984c69d-ba75-45f2-a16d-b953d3bb2a02,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43a157cb9584ca5ab77f503a638a98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:06Z,use_quota=True,user_id='cb366bcdaf5f422ab5506b6d72edcd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Creating volume 9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:23:05 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:23:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:05 devstack sudo[102969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 1073741824 Jul 06 21:23:05 devstack sudo[102969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:06 devstack sudo[102969]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 1073741824" returned: 0 in 0.875s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:06 devstack sudo[102975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 Jul 06 21:23:06 devstack sudo[102975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:07 devstack sudo[102975]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02" returned: 0 in 0.702s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] <== create_volume: return (1617ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.620s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b827bf2d-dd9c-46c4-8dca-416cffa207eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab9beb3-36ea-4aae-bbaa-548d400a069c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Volume volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 (9984c69d-ba75-45f2-a16d-b953d3bb2a02): created successfully Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ab9beb3-36ea-4aae-bbaa-548d400a069c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Flow 'volume_create_manager' (69d30609-a648-4cdf-a510-e250838ce661) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a4df2755-0e99-40d8-a3ba-ea20bbe4e402 tempest-VolumeDependencyTests-261903479 None] Created volume successfully. Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Creating offline snapshot c3a8c80e-8c0a-4265-b65f-815e54cbe4fa of volume 9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c08426a-843e-41f0-89d2-2f213c59a50e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:08 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 Jul 06 21:23:08 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:08 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:08 devstack sudo[102984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa 1G Jul 06 21:23:08 devstack sudo[102984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:09 devstack sudo[102984]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa 1G" returned: 0 in 0.823s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:09 devstack sudo[102989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa Jul 06 21:23:09 devstack sudo[102989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:10 devstack sudo[102989]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" returned: 0 in 0.823s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:10 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa is being set with open permissions: ugo+rw Jul 06 21:23:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:10 devstack sudo[102994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa Jul 06 21:23:10 devstack sudo[102994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:11 devstack sudo[102994]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" returned: 0 in 0.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:11 devstack sudo[102997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.info Jul 06 21:23:11 devstack sudo[102997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:11 devstack sudo[102997]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.info" returned: 0 in 0.650s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:11 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.info is being set with open permissions: ugo+rw Jul 06 21:23:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:11 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.info Jul 06 21:23:11 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:12 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.info" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.538s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-071ab763-f334-4145-996c-f990aa039164 tempest-VolumeDependencyTests-261903479 None] Create snapshot completed successfully Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Flow 'volume_create_manager' (c0c53e8a-8848-46d5-bd7e-61fbd5a50ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15723005-bff3-4d41-b9b7-8018cc45571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15723005-bff3-4d41-b9b7-8018cc45571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1596385181',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e43a157cb9584ca5ab77f503a638a98b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=c3a8c80e-8c0a-4265-b65f-815e54cbe4fa,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:14Z,use_quota=True,user_id='cb366bcdaf5f422ab5506b6d72edcd88',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d4adcf-8fea-436e-ab90-bf800fc3b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2d4adcf-8fea-436e-ab90-bf800fc3b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f84927a-c01c-423f-8c1a-ad8fa1f8b94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f84927a-c01c-423f-8c1a-ad8fa1f8b94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d', 'volume_name': 'volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d', 'volume_size': 1, 'snapshot_id': 'c3a8c80e-8c0a-4265-b65f-815e54cbe4fa'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bba2534-6869-449e-a84b-9e620f1f7851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bba2534-6869-449e-a84b-9e620f1f7851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bed8a1-c8b1-40ae-b6cf-e1e6b97b2818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Volume 7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d', 'volume_size': 1, 'snapshot_id': 'c3a8c80e-8c0a-4265-b65f-815e54cbe4fa'} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-quobyte-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Creating volume 7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d from snapshot c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-quobyte-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] snapshot: c3a8c80e-8c0a-4265-b65f-815e54cbe4fa, volume: 7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c045c3ad-7855-4a01-8d93-ad02f7ad308f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:14 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa Jul 06 21:23:14 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:14 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" returned: 0 in 0.871s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:23:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:23:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:23:14 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6a6acb0-9877-4ac5-bcf6-8f22f0a2c678]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:14 devstack sudo[103009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 Jul 06 21:23:14 devstack sudo[103009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:15 devstack sudo[103009]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02" returned: 0 in 0.880s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:15 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:23:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:15 devstack sudo[103014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d Jul 06 21:23:15 devstack sudo[103014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:20 devstack sudo[103014]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" returned: 0 in 5.242s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72d4da6-b28f-433e-87d2-7b6ee4a30dc9]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:21 devstack sudo[103028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 Jul 06 21:23:21 devstack sudo[103028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:21 devstack sudo[103028]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02" returned: 0 in 0.970s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:21 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02, size 1024.00 MB, duration 5.24 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:23:21 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Converted 1024.00 MB image at 195.32 MB/s Jul 06 21:23:21 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d is being set with open permissions: ugo+rw Jul 06 21:23:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:21 devstack sudo[103033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d Jul 06 21:23:21 devstack sudo[103033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:22 devstack sudo[103033]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" returned: 0 in 0.647s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" released by "_copy_volume_from_snapshot" :: held 8.705s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" released by "_create_volume_from_snapshot" :: held 8.735s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.751s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bed8a1-c8b1-40ae-b6cf-e1e6b97b2818) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d', 'volume_size': 1, 'snapshot_id': 'c3a8c80e-8c0a-4265-b65f-815e54cbe4fa'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c967b20-005b-4775-b0f6-97ef0e814760) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:22 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Volume volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d (7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d): created successfully Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c967b20-005b-4775-b0f6-97ef0e814760) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Flow 'volume_create_manager' (c0c53e8a-8848-46d5-bd7e-61fbd5a50ac6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:22 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-29dd1f48-283a-4bb7-9c06-d2897da44458 tempest-VolumeDependencyTests-261903479 None] Created volume successfully. Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-quobyte-9984c69d-ba75-45f2-a16d-b953d3bb2a02" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-9984c69d-ba75-45f2-a16d-b953d3bb2a02" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-quobyte-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Deleting offline snapshot c3a8c80e-8c0a-4265-b65f-815e54cbe4fa of volume 9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] snapshot_file for this snap is: volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d6bddb1-af2d-4f70-861f-601e5f412c5b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:23 devstack sudo[103036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa Jul 06 21:23:23 devstack sudo[103036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:24 devstack sudo[103036]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" returned: 0 in 0.768s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:23:24 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[03edb1ee-de16-4928-b6b6-c271dce11d51]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:24 devstack sudo[103041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 Jul 06 21:23:24 devstack sudo[103041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:25 devstack sudo[103041]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02" returned: 0 in 0.889s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:25 devstack sudo[103046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa Jul 06 21:23:25 devstack sudo[103046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:26 devstack sudo[103046]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" returned: 0 in 0.878s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:26 devstack sudo[103051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa Jul 06 21:23:26 devstack sudo[103051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:26 devstack sudo[103051]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02.c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" returned: 0 in 0.708s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:26 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=74,cinder:UPDATE=98,cinder:INSERT=22,cinder:DELETE=10 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:23:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa" released by "_delete_snapshot" :: held 3.365s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-9984c69d-ba75-45f2-a16d-b953d3bb2a02" released by "delete_snapshot" :: held 3.391s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:27 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=100,cinder:INSERT=24,cinder:DELETE=9,cinder:SELECT=74 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:23:27 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Created reservations ['6f29663a-b6c6-421f-af10-c75d940010e4', '0a03505a-d329-4fa8-af59-fd6e73591f3f', '3777f9d7-8970-4a00-b3f3-a6dbfbb664d0', '79ffe78a-c45a-4d10-a19b-c570e834afc8'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:23:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Delete snapshot completed successfully. Jul 06 21:23:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-96123018-e622-495f-aff3-22ba49e0f5f7 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-c3a8c80e-8c0a-4265-b65f-815e54cbe4fa-delete_snapshot" released by "delete_snapshot" :: held 3.551s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-9984c69d-ba75-45f2-a16d-b953d3bb2a02-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-9984c69d-ba75-45f2-a16d-b953d3bb2a02-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-quobyte-9984c69d-ba75-45f2-a16d-b953d3bb2a02" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-9984c69d-ba75-45f2-a16d-b953d3bb2a02" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[703dd5e1-5869-47bc-b92f-d4217f5c80f0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:28 devstack sudo[103054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 Jul 06 21:23:28 devstack sudo[103054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:28 devstack sudo[103054]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02" returned: 0 in 0.788s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:28 devstack sudo[103060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02 Jul 06 21:23:28 devstack sudo[103060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:29 devstack sudo[103060]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9984c69d-ba75-45f2-a16d-b953d3bb2a02" returned: 0 in 0.662s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-9984c69d-ba75-45f2-a16d-b953d3bb2a02" released by "delete_volume" :: held 1.510s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Created reservations ['79fdfaa6-5b4b-4e26-a50f-a4c0503c1a61', '44834cd3-e885-41d8-8994-6c1c61b5b810', '510eca97-c5f8-4223-9490-3d3e6100cb4b', '89a23fce-f2ad-4958-9982-36f2cfcc6cee'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:29 devstack sudo[103063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:23:29 devstack sudo[103063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "cinder-quobyte-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[67e13c26-85d3-4dff-88ce-018ea5d92e92]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:30 devstack sudo[103063]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:23:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Deleted volume successfully. Jul 06 21:23:30 devstack sudo[103066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d Jul 06 21:23:30 devstack sudo[103066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d607bc4f-93da-4758-905b-5b9cec90df63 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-9984c69d-ba75-45f2-a16d-b953d3bb2a02-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:31 devstack sudo[103066]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:31 devstack sudo[103071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d Jul 06 21:23:31 devstack sudo[103071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Flow 'volume_create_manager' (e329ba7d-6268-4426-942a-0bc7cf3659b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c973e3d2-5d49-40ee-83a9-a514ad7251f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c973e3d2-5d49-40ee-83a9-a514ad7251f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2120772679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31612a7349ed41a1a9f5f98342ce854d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:32Z,use_quota=True,user_id='7df64cb754d74682997a01e06decf5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee3c174-919d-4daf-a58b-0151b3498e5a),volume_type_id=5ee3c174-919d-4daf-a58b-0151b3498e5a)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ae1116-2c8f-4e65-8b60-4afa38442768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3ae1116-2c8f-4e65-8b60-4afa38442768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dea0a2a-aa12-4cc6-bcc7-0d03d04729e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dea0a2a-aa12-4cc6-bcc7-0d03d04729e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd', 'volume_name': 'volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2db52df-9ecb-48ed-bcbe-7f8a16eb1d88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2db52df-9ecb-48ed-bcbe-7f8a16eb1d88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48849f9-6636-4e2f-9fe7-b5b4132f7a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:31 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume 1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd', 'volume_size': 1} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-2120772679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31612a7349ed41a1a9f5f98342ce854d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:32Z,use_quota=True,user_id='7df64cb754d74682997a01e06decf5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5ee3c174-919d-4daf-a58b-0151b3498e5a),volume_type_id=5ee3c174-919d-4daf-a58b-0151b3498e5a)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Creating volume 1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:23:31 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:31 devstack sudo[103074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd 1073741824 Jul 06 21:23:31 devstack sudo[103074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:31 devstack sudo[103071]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" returned: 0 in 0.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-quobyte-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d" released by "delete_volume" :: held 1.560s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Created reservations ['8d39bbff-30c3-4620-9f03-089fc6e4beff', '4b19b441-37a6-414a-9841-05d004657629', '0d35887f-dad1-43cc-b708-03d8b56cb919', '41988221-691c-4e4b-ac2a-0dab0f2c9a7c'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:31 devstack sudo[103076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:23:31 devstack sudo[103076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Flow 'volume_create_manager' (e16f3d3c-2a28-4e94-9ea5-307da2e2c2ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657dfdfd-445c-4d6d-b798-b01ca214b02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (657dfdfd-445c-4d6d-b798-b01ca214b02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-372748631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf02df8-b66f-44c3-8d9f-5ebceaf87956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31612a7349ed41a1a9f5f98342ce854d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:32Z,use_quota=True,user_id='7df64cb754d74682997a01e06decf5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(630a7086-3dc6-412f-9f8f-ce60aafd0f4c),volume_type_id=630a7086-3dc6-412f-9f8f-ce60aafd0f4c)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545f31cd-de18-4ed7-8b46-aa3c40d2da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (545f31cd-de18-4ed7-8b46-aa3c40d2da82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9858ef5a-f83f-4cad-a776-5c883f1a7c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9858ef5a-f83f-4cad-a776-5c883f1a7c1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2cf02df8-b66f-44c3-8d9f-5ebceaf87956', 'volume_name': 'volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a5def5-4402-4ce0-8c30-fbb616101720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08a5def5-4402-4ce0-8c30-fbb616101720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2769999b-771b-4b02-82a1-ef02c73bda7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume 2cf02df8-b66f-44c3-8d9f-5ebceaf87956: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956', 'volume_size': 1} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Flow 'volume_create_manager' (eb616b0a-d209-47ac-8f01-cc0a048903cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a06444-3d5f-4384-a7b4-3a6945aeb2f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack sudo[103076]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.881s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:23:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Deleted volume successfully. Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2a06444-3d5f-4384-a7b4-3a6945aeb2f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-158330343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e02b54-7995-4f94-98b9-3259c4e7dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31612a7349ed41a1a9f5f98342ce854d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:33Z,use_quota=True,user_id='7df64cb754d74682997a01e06decf5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48c4d247-8849-4d4b-bc5a-5244e1d613d9),volume_type_id=48c4d247-8849-4d4b-bc5a-5244e1d613d9)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47eb015-9077-4f47-8e03-4a05936f61c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a47eb015-9077-4f47-8e03-4a05936f61c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000d3381-97f7-4f79-9086-4d4156220753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-632ef0a8-2dab-4636-a593-851b284f8039 tempest-VolumeDependencyTests-261903479 None] Lock "cinder-7e8aa990-ed7d-4dd5-8461-ff2b752a7e7d-delete_volume" released by "delete_volume" :: held 2.736s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:32 devstack sudo[103074]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd 1073741824" returned: 0 in 1.234s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:33 devstack sudo[103082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd Jul 06 21:23:33 devstack sudo[103082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (000d3381-97f7-4f79-9086-4d4156220753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '97e02b54-7995-4f94-98b9-3259c4e7dc6b', 'volume_name': 'volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b', 'volume_size': 1, 'image_id': '4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1393073363', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31612a7349ed41a1a9f5f98342ce854d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'created_at': datetime.datetime(2026, 7, 6, 19, 23, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 23, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1/file', 'properties': {}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e02ba7-9c05-4bac-8914-36d739c248fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21e02ba7-9c05-4bac-8914-36d739c248fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d208b-d1f7-4c06-bd92-d37239f85b61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:33 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume 97e02b54-7995-4f94-98b9-3259c4e7dc6b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b', 'volume_size': 1, 'image_id': '4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1393073363', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31612a7349ed41a1a9f5f98342ce854d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'created_at': datetime.datetime(2026, 7, 6, 19, 23, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 23, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1/file', 'properties': {}}, 'image_service': } Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Trying to clone 97e02b54-7995-4f94-98b9-3259c4e7dc6b from image 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 at location (None, [{'url': 'file:///opt/stack/data/glance/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:23:33 devstack sudo[103082]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd" returned: 0 in 0.789s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] <== create_volume: return (2070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.075s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.619s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-372748631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2cf02df8-b66f-44c3-8d9f-5ebceaf87956,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31612a7349ed41a1a9f5f98342ce854d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:32Z,use_quota=True,user_id='7df64cb754d74682997a01e06decf5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(630a7086-3dc6-412f-9f8f-ce60aafd0f4c),volume_type_id=630a7086-3dc6-412f-9f8f-ce60aafd0f4c)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Creating volume 2cf02df8-b66f-44c3-8d9f-5ebceaf87956 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:23:33 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c48849f9-6636-4e2f-9fe7-b5b4132f7a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea12616e-1563-48f7-beeb-c564f5dbef87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:33 devstack sudo[103085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 1073741824 Jul 06 21:23:33 devstack sudo[103085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:33 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd (1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd): created successfully Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea12616e-1563-48f7-beeb-c564f5dbef87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Flow 'volume_create_manager' (e329ba7d-6268-4426-942a-0bc7cf3659b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:33 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-35e00a7c-3945-4bb1-8c95-218c3e54f893 tempest-TestInstancesWithCinderVolumes-1175741813 None] Created volume successfully. Jul 06 21:23:34 devstack sudo[103085]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 1073741824" returned: 0 in 0.929s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:34 devstack sudo[103091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 Jul 06 21:23:34 devstack sudo[103091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:35 devstack sudo[103091]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956" returned: 0 in 0.695s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] <== create_volume: return (1680ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:23:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.683s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2769999b-771b-4b02-82a1-ef02c73bda7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b424a61c-fa2e-40b6-990c-cdd1ab977232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 (2cf02df8-b66f-44c3-8d9f-5ebceaf87956): created successfully Jul 06 21:23:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b424a61c-fa2e-40b6-990c-cdd1ab977232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Flow 'volume_create_manager' (e16f3d3c-2a28-4e94-9ea5-307da2e2c2ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-290dadeb-5b0c-45b6-a709-c276c0362e9b tempest-TestInstancesWithCinderVolumes-1175741813 None] Created volume successfully. Jul 06 21:23:36 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD, size 20.69 MB, duration 3.62 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:23:36 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Image download 20.69 MB at 5.72 MB/s Jul 06 21:23:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9bfdea8-ed10-4c2c-9b63-99aa239204fd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:37 devstack sudo[103094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD Jul 06 21:23:37 devstack sudo[103094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:37 devstack sudo[103094]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD" returned: 0 in 0.752s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:37 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Temporary image 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 is fetched for user 7df64cb754d74682997a01e06decf5af. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:23:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[419f1060-11e1-4b6b-a16e-3a5cc80c47f0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:37 devstack sudo[103099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD Jul 06 21:23:37 devstack sudo[103099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Flow 'volume_create_manager' (45a176c6-9e85-4127-9ee3-3ec6a10d8b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd79ee-05a0-4532-b497-701a00d3a511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccd79ee-05a0-4532-b497-701a00d3a511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9238248-5932-4645-a9a6-126dcf6b5695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0181fcb3a42db9923041f75bdcc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:38Z,use_quota=True,user_id='f8e5f101a12a42fab868d360e6d08fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578c62a1-e966-4449-a4c2-dd37362757dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (578c62a1-e966-4449-a4c2-dd37362757dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fb9754-bf54-4bb9-9774-66ebd80d2651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08fb9754-bf54-4bb9-9774-66ebd80d2651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'd9238248-5932-4645-a9a6-126dcf6b5695', 'volume_name': 'volume-d9238248-5932-4645-a9a6-126dcf6b5695', 'volume_size': 1, 'image_id': '83a8cbf4-8a0f-479b-9481-e668746d3924', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a8cbf4-8a0f-479b-9481-e668746d3924', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '498e3805c77104849f79900ba949b5ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8f0181fcb3a42db9923041f75bdcc39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dbfedae75522b8edf1630c23daec1ff2943ffdb288db504934a361a1bdf33c1953be16df0bfd12da58b6ab8ab07afa9f0b9af830dce10fdabaa6a08ebd2c614', 'id': '83a8cbf4-8a0f-479b-9481-e668746d3924', 'created_at': datetime.datetime(2026, 7, 6, 19, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 23, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a8cbf4-8a0f-479b-9481-e668746d3924/file', 'properties': {}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097467f8-dc1c-4f95-83e6-0a8104ebc333) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (097467f8-dc1c-4f95-83e6-0a8104ebc333) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8803387-e832-4891-98b0-85f594103fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:38 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Volume d9238248-5932-4645-a9a6-126dcf6b5695: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-d9238248-5932-4645-a9a6-126dcf6b5695', 'volume_size': 1, 'image_id': '83a8cbf4-8a0f-479b-9481-e668746d3924', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a8cbf4-8a0f-479b-9481-e668746d3924', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '498e3805c77104849f79900ba949b5ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8f0181fcb3a42db9923041f75bdcc39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dbfedae75522b8edf1630c23daec1ff2943ffdb288db504934a361a1bdf33c1953be16df0bfd12da58b6ab8ab07afa9f0b9af830dce10fdabaa6a08ebd2c614', 'id': '83a8cbf4-8a0f-479b-9481-e668746d3924', 'created_at': datetime.datetime(2026, 7, 6, 19, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 23, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a8cbf4-8a0f-479b-9481-e668746d3924/file', 'properties': {}}, 'image_service': } Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Trying to clone d9238248-5932-4645-a9a6-126dcf6b5695 from image 83a8cbf4-8a0f-479b-9481-e668746d3924 at location (None, [{'url': 'file:///opt/stack/data/glance/images/83a8cbf4-8a0f-479b-9481-e668746d3924', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:23:38 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Image download 0.00 MB at 0.00 MB/s Jul 06 21:23:38 devstack sudo[103099]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD" returned: 0 in 0.775s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-158330343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e02b54-7995-4f94-98b9-3259c4e7dc6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31612a7349ed41a1a9f5f98342ce854d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:33Z,use_quota=True,user_id='7df64cb754d74682997a01e06decf5af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48c4d247-8849-4d4b-bc5a-5244e1d613d9),volume_type_id=48c4d247-8849-4d4b-bc5a-5244e1d613d9)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Creating volume 97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:23:38 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2dcdcc-a7e3-4f3a-ae30-28e95abaf4f7]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:38 devstack sudo[103104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b 1073741824 Jul 06 21:23:38 devstack sudo[103104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:38 devstack sudo[103105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD Jul 06 21:23:38 devstack sudo[103105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:39 devstack sudo[103105]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD" returned: 0 in 0.767s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:39 devstack sudo[103104]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b 1073741824" returned: 0 in 0.845s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:39 devstack sudo[103117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:23:39 devstack sudo[103117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:39 devstack sudo[103116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD Jul 06 21:23:39 devstack sudo[103116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:40 devstack sudo[103116]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD" returned: 1 in 0.733s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Temporary image 83a8cbf4-8a0f-479b-9481-e668746d3924 is fetched for user f8e5f101a12a42fab868d360e6d08fc8. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:23:40 devstack sudo[103117]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] <== create_volume: return (1553ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.556s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Attempting download of 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'metadata': {}}])) to volume 97e02b54-7995-4f94-98b9-3259c4e7dc6b. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e07e0384-f8e0-479f-8a7b-194c6fcaeb5f]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb8b1ba7-2b10-4c47-b613-e4fe3bea4a35]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_ai12o11f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:40 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD Jul 06 21:23:40 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:40 devstack sudo[103125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_ai12o11f Jul 06 21:23:40 devstack sudo[103125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:40 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:40 devstack sudo[103125]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_ai12o11f" returned: 0 in 0.707s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_ai12o11f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:40 devstack sudo[103132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD Jul 06 21:23:40 devstack sudo[103132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:40 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_ai12o11f Jul 06 21:23:40 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:41 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_ai12o11f" returned: 1 in 0.717s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_ai12o11f' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[159b792d-b120-4efc-9d75-40d03c8d885f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:41 devstack sudo[103132]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:38Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9238248-5932-4645-a9a6-126dcf6b5695,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8f0181fcb3a42db9923041f75bdcc39',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:38Z,use_quota=True,user_id='f8e5f101a12a42fab868d360e6d08fc8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Creating volume d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:23:41 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:23:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:41 devstack sudo[103142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 1073741824 Jul 06 21:23:41 devstack sudo[103142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:41 devstack sudo[103141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD Jul 06 21:23:41 devstack sudo[103141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:42 devstack sudo[103141]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD" returned: 0 in 0.758s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:42 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 was qcow2, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:23:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:42 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:23:42 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:42 devstack sudo[103142]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 1073741824" returned: 0 in 0.890s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:42 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 Jul 06 21:23:42 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:43 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695" returned: 0 in 0.716s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] <== create_volume: return (1652ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:23:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.655s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:43 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Attempting download of 83a8cbf4-8a0f-479b-9481-e668746d3924 ((None, [{'url': 'file:///opt/stack/data/glance/images/83a8cbf4-8a0f-479b-9481-e668746d3924', 'metadata': {}}])) to volume d9238248-5932-4645-a9a6-126dcf6b5695. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:23:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f400c90c-def0-4188-bc26-052d6fa4fb05]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a8cbf4-8a0f-479b-9481-e668746d3924_1n596e_q {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:43 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a8cbf4-8a0f-479b-9481-e668746d3924_1n596e_q Jul 06 21:23:43 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:44 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_83a8cbf4-8a0f-479b-9481-e668746d3924_1n596e_q" returned: 0 in 0.773s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a8cbf4-8a0f-479b-9481-e668746d3924_1n596e_q {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:44 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 0 in 1.858s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_4ca5946a-988d-4f76-8f7c-de1c942ea6a1_rc7xit4tdevstack@QuobyteHD, size 112.00 MB, duration 1.86 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:23:44 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Converted 112.00 MB image at 60.23 MB/s Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:44 devstack sudo[103170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b 1G Jul 06 21:23:44 devstack sudo[103170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:44 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a8cbf4-8a0f-479b-9481-e668746d3924_1n596e_q Jul 06 21:23:44 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:44 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a8cbf4-8a0f-479b-9481-e668746d3924_1n596e_q" returned: 1 in 0.746s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_83a8cbf4-8a0f-479b-9481-e668746d3924_1n596e_q' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6555b593-1c56-4835-9626-09e615afe3ca]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:44 devstack sudo[103170]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b 1G" returned: 0 in 0.735s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[07370742-9f13-417f-a308-91cfe13b7a7c]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:44 devstack sudo[103178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD Jul 06 21:23:44 devstack sudo[103178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:45 devstack sudo[103179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:23:45 devstack sudo[103179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:45 devstack sudo[103178]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD" returned: 0 in 0.727s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:45 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD Jul 06 21:23:45 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:45 devstack sudo[103179]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 0 in 0.771s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:45 devstack sudo[103188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:23:45 devstack sudo[103188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:46 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD" returned: 1 in 0.737s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] 83a8cbf4-8a0f-479b-9481-e668746d3924 was raw, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:46 devstack sudo[103193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 Jul 06 21:23:46 devstack sudo[103193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:46 devstack sudo[103188]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 1 in 0.782s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Downloaded image 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 ((None, [{'url': 'file:///opt/stack/data/glance/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'metadata': {}}])) to volume 97e02b54-7995-4f94-98b9-3259c4e7dc6b successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Temporary image 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 for user 7df64cb754d74682997a01e06decf5af is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Marking volume 97e02b54-7995-4f94-98b9-3259c4e7dc6b as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Copying metadata from image 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 to 97e02b54-7995-4f94-98b9-3259c4e7dc6b. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Creating volume glance metadata for volume 97e02b54-7995-4f94-98b9-3259c4e7dc6b backed by image 4ca5946a-988d-4f76-8f7c-de1c942ea6a1 with: {'image_id': '4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'image_name': 'tempest-scenario-img--1393073363', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (530d208b-d1f7-4c06-bd92-d37239f85b61) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b', 'volume_size': 1, 'image_id': '4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1393073363', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31612a7349ed41a1a9f5f98342ce854d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '4ca5946a-988d-4f76-8f7c-de1c942ea6a1', 'created_at': datetime.datetime(2026, 7, 6, 19, 23, 29, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 23, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/4ca5946a-988d-4f76-8f7c-de1c942ea6a1/file', 'properties': {}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d46dbb6-013c-48d1-afcd-97271ed7bbad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:46 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Volume volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b (97e02b54-7995-4f94-98b9-3259c4e7dc6b): created successfully Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d46dbb6-013c-48d1-afcd-97271ed7bbad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Flow 'volume_create_manager' (eb616b0a-d209-47ac-8f01-cc0a048903cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-331e1ba2-1311-4db6-b99b-e0e9644ccd8e tempest-TestInstancesWithCinderVolumes-1175741813 None] Created volume successfully. Jul 06 21:23:47 devstack sudo[103193]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695" returned: 0 in 0.747s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:47 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_83a8cbf4-8a0f-479b-9481-e668746d3924_lec8coyxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:23:47 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 21:23:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:47 devstack sudo[103201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 1G Jul 06 21:23:47 devstack sudo[103201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:47 devstack sudo[103201]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 1G" returned: 0 in 0.681s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:47 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[beea0fa0-6900-408e-8bcf-1709f3dc25ca]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:47 devstack sudo[103206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 Jul 06 21:23:47 devstack sudo[103206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:48 devstack sudo[103206]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695" returned: 0 in 0.793s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:48 devstack sudo[103210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 Jul 06 21:23:48 devstack sudo[103210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:49 devstack sudo[103210]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695" returned: 1 in 0.821s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Downloaded image 83a8cbf4-8a0f-479b-9481-e668746d3924 ((None, [{'url': 'file:///opt/stack/data/glance/images/83a8cbf4-8a0f-479b-9481-e668746d3924', 'metadata': {}}])) to volume d9238248-5932-4645-a9a6-126dcf6b5695 successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Temporary image 83a8cbf4-8a0f-479b-9481-e668746d3924 for user f8e5f101a12a42fab868d360e6d08fc8 is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Marking volume d9238248-5932-4645-a9a6-126dcf6b5695 as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Copying metadata from image 83a8cbf4-8a0f-479b-9481-e668746d3924 to d9238248-5932-4645-a9a6-126dcf6b5695. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Creating volume glance metadata for volume d9238248-5932-4645-a9a6-126dcf6b5695 backed by image 83a8cbf4-8a0f-479b-9481-e668746d3924 with: {'image_id': '83a8cbf4-8a0f-479b-9481-e668746d3924', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '498e3805c77104849f79900ba949b5ae', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8803387-e832-4891-98b0-85f594103fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9238248-5932-4645-a9a6-126dcf6b5695', 'volume_size': 1, 'image_id': '83a8cbf4-8a0f-479b-9481-e668746d3924', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/83a8cbf4-8a0f-479b-9481-e668746d3924', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '498e3805c77104849f79900ba949b5ae', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b8f0181fcb3a42db9923041f75bdcc39', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '1dbfedae75522b8edf1630c23daec1ff2943ffdb288db504934a361a1bdf33c1953be16df0bfd12da58b6ab8ab07afa9f0b9af830dce10fdabaa6a08ebd2c614', 'id': '83a8cbf4-8a0f-479b-9481-e668746d3924', 'created_at': datetime.datetime(2026, 7, 6, 19, 23, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 23, 37, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/83a8cbf4-8a0f-479b-9481-e668746d3924/file', 'properties': {}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a06cd7-78db-40a9-88ee-ea315aed365f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Volume volume-d9238248-5932-4645-a9a6-126dcf6b5695 (d9238248-5932-4645-a9a6-126dcf6b5695): created successfully Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (60a06cd7-78db-40a9-88ee-ea315aed365f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Flow 'volume_create_manager' (45a176c6-9e85-4127-9ee3-3ec6a10d8b15) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-47b3cda2-ae12-4178-8595-ca2304b26795 tempest-VolumeImageDependencyTests-528642299 None] Created volume successfully. Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Acquiring lock "cinder-d9238248-5932-4645-a9a6-126dcf6b5695-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Lock "cinder-d9238248-5932-4645-a9a6-126dcf6b5695-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Acquiring lock "cinder-quobyte-d9238248-5932-4645-a9a6-126dcf6b5695" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Lock "cinder-quobyte-d9238248-5932-4645-a9a6-126dcf6b5695" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9235d3d1-3923-4819-b8de-7bd1c156ee03]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:50 devstack sudo[103253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 Jul 06 21:23:50 devstack sudo[103253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:50 devstack sudo[103253]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695" returned: 0 in 0.781s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:50 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 Jul 06 21:23:50 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:51 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695" returned: 1 in 0.744s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:51 devstack sudo[103264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695 Jul 06 21:23:51 devstack sudo[103264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:52 devstack sudo[103264]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9238248-5932-4645-a9a6-126dcf6b5695" returned: 0 in 0.632s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Lock "cinder-quobyte-d9238248-5932-4645-a9a6-126dcf6b5695" released by "delete_volume" :: held 2.221s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Created reservations ['8c73828a-c4f3-458e-adb7-35d9698d84d8', '5edb0dd0-eff3-4f50-a498-bf6230c54a18', '63533a02-5442-4afe-881a-2d6296c02276', '455a5c5d-29c2-468b-8792-070d7008cbbe'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:52 devstack sudo[103267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:23:52 devstack sudo[103267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:52 devstack sudo[103267]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:23:52 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Deleted volume successfully. Jul 06 21:23:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d7d931d8-8f02-4cf7-ab7c-9ffa9988e643 tempest-VolumeImageDependencyTests-528642299 None] Lock "cinder-d9238248-5932-4645-a9a6-126dcf6b5695-delete_volume" released by "delete_volume" :: held 3.086s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:23:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b59a81a-b192-4639-9e59-593765d77295]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:55 devstack sudo[103279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:23:55 devstack sudo[103279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:56 devstack sudo[103279]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:56 devstack sudo[103285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:23:56 devstack sudo[103285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:56 devstack sudo[103285]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 1 in 0.805s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:23:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.689s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a9c286f-b028-4a69-9e0a-b1bc12143cb7', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:23:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-6c2a4535-6e1c-448d-a65c-ef6faead0991 req-4411d725-b48c-4d23-a98e-c64b4d95411c tempest-TestInstancesWithCinderVolumes-1175741813 None] attachment_update completed successfully. Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (b9dedcec-5e91-485b-b432-dc9e3082c8be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90df945-c85b-4fbc-a293-2279f0efce9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b90df945-c85b-4fbc-a293-2279f0efce9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341897785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2f582b-f05b-4a4d-a649-b9fa3b5842e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:57Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82110872-f4b5-4fc8-bb9d-76cb470a6517) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82110872-f4b5-4fc8-bb9d-76cb470a6517) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1b537a-0587-46f8-a733-40e78edcd27c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f1b537a-0587-46f8-a733-40e78edcd27c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d2f582b-f05b-4a4d-a649-b9fa3b5842e1', 'volume_name': 'volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61cdb3b-6851-4a8b-b658-2f67f612934c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a61cdb3b-6851-4a8b-b658-2f67f612934c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cd147e-3760-4fce-98a8-219be50a1f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Volume 1d2f582b-f05b-4a4d-a649-b9fa3b5842e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1', 'volume_size': 1} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:23:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1341897785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d2f582b-f05b-4a4d-a649-b9fa3b5842e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:23:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:23:57Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Creating volume 1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:23:57 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:23:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:57 devstack sudo[103296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 1073741824 Jul 06 21:23:57 devstack sudo[103296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:58 devstack sudo[103296]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 1073741824" returned: 0 in 0.848s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:58 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 Jul 06 21:23:58 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:23:59 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6cd147e-3760-4fce-98a8-219be50a1f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04412452-8519-4490-805f-96219b876b39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:23:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Volume volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 (1d2f582b-f05b-4a4d-a649-b9fa3b5842e1): created successfully Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04412452-8519-4490-805f-96219b876b39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (b9dedcec-5e91-485b-b432-dc9e3082c8be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:23:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-93d98e10-1810-43e4-96ee-faeec3925e96 tempest-ProjectReaderTests-1454297232 None] Created volume successfully. Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-quobyte-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1f7c040-c515-4914-acec-b3da3edddb04]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:23:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:23:59 devstack sudo[103376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 Jul 06 21:23:59 devstack sudo[103376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:00 devstack sudo[103376]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1" returned: 0 in 0.919s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:00 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1 Jul 06 21:24:00 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:01 devstack sudo[103428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:24:01 devstack sudo[103428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:01 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1" returned: 0 in 0.746s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1" released by "delete_volume" :: held 1.721s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Created reservations ['1f6f5ebe-f24f-4292-bdd2-9551e4196237', 'df9b34be-8f62-433c-ae88-d02e354572cb', '7314cbf6-00c9-4627-b61c-ea69e2443180', '56778cd6-6f49-4bd4-b35a-fa0d42c025c6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:01 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:24:01 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:01 devstack sudo[103428]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.712s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:24:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:24:02 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.694s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:24:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Deleted volume successfully. Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-75eadc71-592f-4791-9975-89b0d7173e16 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-1d2f582b-f05b-4a4d-a649-b9fa3b5842e1-delete_volume" released by "delete_volume" :: held 2.654s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (aec34dd6-36aa-40c1-b390-d4b206b91a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856e52e-125c-44b6-87b4-ebf2b29e3dc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b856e52e-125c-44b6-87b4-ebf2b29e3dc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1561672190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2156f3f9-3f29-4573-b84e-cd2065bc4cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:24:02Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6eaf718-f96f-4730-91c3-46c1db83192e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6eaf718-f96f-4730-91c3-46c1db83192e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66180d8c-20c4-492a-988a-9b09a124cc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (66180d8c-20c4-492a-988a-9b09a124cc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2156f3f9-3f29-4573-b84e-cd2065bc4cc1', 'volume_name': 'volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a0a4e3-ff36-43f7-9b60-9c40b9425bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (29a0a4e3-ff36-43f7-9b60-9c40b9425bcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c78db51-36b5-455d-9a48-118b3963941b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Volume 2156f3f9-3f29-4573-b84e-cd2065bc4cc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1', 'volume_size': 1} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:24:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1561672190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2156f3f9-3f29-4573-b84e-cd2065bc4cc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:24:02Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Creating volume 2156f3f9-3f29-4573-b84e-cd2065bc4cc1 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:24:02 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:24:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:02 devstack sudo[103767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 1073741824 Jul 06 21:24:02 devstack sudo[103767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:03 devstack sudo[103767]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 1073741824" returned: 0 in 0.892s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:03 devstack sudo[103774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 Jul 06 21:24:03 devstack sudo[103774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:04 devstack sudo[103774]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1" returned: 0 in 0.727s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] <== create_volume: return (1663ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.669s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c78db51-36b5-455d-9a48-118b3963941b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10f7fa8-68e2-4061-8b64-e2d3c4fddb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Volume volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 (2156f3f9-3f29-4573-b84e-cd2065bc4cc1): created successfully Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d10f7fa8-68e2-4061-8b64-e2d3c4fddb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (aec34dd6-36aa-40c1-b390-d4b206b91a47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:24:04 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3f0501b2-ee89-4773-bd38-1ab7a7e37ef9 tempest-ProjectReaderTests-1454297232 None] Created volume successfully. Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-2156f3f9-3f29-4573-b84e-cd2065bc4cc1-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-2156f3f9-3f29-4573-b84e-cd2065bc4cc1-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-quobyte-2156f3f9-3f29-4573-b84e-cd2065bc4cc1" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-2156f3f9-3f29-4573-b84e-cd2065bc4cc1" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdc5919b-7866-43c3-abb5-97710c240eec]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:24:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:04 devstack sudo[103777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 Jul 06 21:24:04 devstack sudo[103777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:05 devstack sudo[103777]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1" returned: 0 in 0.812s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:05 devstack sudo[103782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1 Jul 06 21:24:05 devstack sudo[103782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:06 devstack sudo[103782]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2156f3f9-3f29-4573-b84e-cd2065bc4cc1" returned: 0 in 0.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-2156f3f9-3f29-4573-b84e-cd2065bc4cc1" released by "delete_volume" :: held 1.592s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Created reservations ['a81338e8-8d9d-494c-b314-923be07149ad', '4078d7cb-ce9d-41ae-9daf-1226be8cc052', '4be05d79-f8cd-40ba-8a97-7cab0726fa37', 'b631c93b-6a93-4994-a3cc-ef5b6af0599b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:06 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:24:06 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:07 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.966s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:24:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Deleted volume successfully. Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83665dda-66b5-4714-a33b-63dbe1ed7cd4 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-2156f3f9-3f29-4573-b84e-cd2065bc4cc1-delete_volume" released by "delete_volume" :: held 2.863s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (f65bf51a-af20-4260-afcf-ce8215d9b973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e578e3-5f72-4557-a74a-ce2089513948) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c0e578e3-5f72-4557-a74a-ce2089513948) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720532346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5ff3c7-4509-4a6d-8bc9-102c60469767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:24:08Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7610981-193a-49c4-ab6c-24bce15bf780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7610981-193a-49c4-ab6c-24bce15bf780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a84c89f-1933-4b38-b033-f65a4d7a2af3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a84c89f-1933-4b38-b033-f65a4d7a2af3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4c5ff3c7-4509-4a6d-8bc9-102c60469767', 'volume_name': 'volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ac75e6-fc42-4595-ad45-ce0ad596c914) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58ac75e6-fc42-4595-ad45-ce0ad596c914) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a26469-be9c-4c6c-9ede-c42b6abda691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Volume 4c5ff3c7-4509-4a6d-8bc9-102c60469767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767', 'volume_size': 1} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:24:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1720532346',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4c5ff3c7-4509-4a6d-8bc9-102c60469767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:24:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:24:08Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Creating volume 4c5ff3c7-4509-4a6d-8bc9-102c60469767 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:24:07 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:24:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:07 devstack sudo[103790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 1073741824 Jul 06 21:24:07 devstack sudo[103790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:08 devstack sudo[103790]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 1073741824" returned: 0 in 1.070s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:08 devstack sudo[103798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 Jul 06 21:24:08 devstack sudo[103798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:09 devstack sudo[103798]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767" returned: 0 in 0.752s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] <== create_volume: return (1884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:24:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54a26469-be9c-4c6c-9ede-c42b6abda691) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c573471f-01a1-4110-a971-52e0e951a018) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:09 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Volume volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 (4c5ff3c7-4509-4a6d-8bc9-102c60469767): created successfully Jul 06 21:24:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c573471f-01a1-4110-a971-52e0e951a018) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (f65bf51a-af20-4260-afcf-ce8215d9b973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:24:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7ddfbe15-4575-4094-82a7-a16610eecfa2 tempest-ProjectReaderTests-1454297232 None] Created volume successfully. Jul 06 21:24:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-4c5ff3c7-4509-4a6d-8bc9-102c60469767-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-4c5ff3c7-4509-4a6d-8bc9-102c60469767-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-quobyte-4c5ff3c7-4509-4a6d-8bc9-102c60469767" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-4c5ff3c7-4509-4a6d-8bc9-102c60469767" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:11 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbe5d414-b103-4f55-b839-30693e71b0c8]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:24:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:11 devstack sudo[103802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 Jul 06 21:24:11 devstack sudo[103802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:11 devstack sudo[103802]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767" returned: 0 in 0.825s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:11 devstack sudo[103807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767 Jul 06 21:24:11 devstack sudo[103807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:12 devstack sudo[103807]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4c5ff3c7-4509-4a6d-8bc9-102c60469767" returned: 0 in 0.697s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-4c5ff3c7-4509-4a6d-8bc9-102c60469767" released by "delete_volume" :: held 1.571s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Created reservations ['a923c1a6-baf3-47dc-a13b-b920ec81f1d3', '25729c71-4c42-4397-a41e-d0115d71f093', 'ec0b57c8-f5aa-4f44-8db8-0773c9bbec28', '18e30ff2-ebf2-4ead-a2e0-64f4e22f978c'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:12 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:24:12 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:13 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.685s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:24:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Deleted volume successfully. Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-25c7e2e0-b435-4215-ab9a-cc001d3cacd2 tempest-ProjectReaderTests-1454297232 None] Lock "cinder-4c5ff3c7-4509-4a6d-8bc9-102c60469767-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (99b9efaf-4524-4fb6-b75a-4cd52c23a93f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d4248e-0a38-4ba9-a6ed-a89b333c9ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2d4248e-0a38-4ba9-a6ed-a89b333c9ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491536359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c737df55-0c0f-4420-8c7c-fa91c19e2dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:24:14Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c775fd59-1421-4940-85c6-d9a309e1ba63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c775fd59-1421-4940-85c6-d9a309e1ba63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198189ef-b02c-4f9f-ba74-aa73d4254a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (198189ef-b02c-4f9f-ba74-aa73d4254a67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c737df55-0c0f-4420-8c7c-fa91c19e2dd9', 'volume_name': 'volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5eb63-febb-4edb-97fd-2b828d497553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0a5eb63-febb-4edb-97fd-2b828d497553) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510d7a2f-d953-49fe-904c-302c8baa4eab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Volume c737df55-0c0f-4420-8c7c-fa91c19e2dd9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9', 'volume_size': 1} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:24:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-491536359',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c737df55-0c0f-4420-8c7c-fa91c19e2dd9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='92baccf1817d44269d55ebb812660dc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:24:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:24:14Z,use_quota=True,user_id='f8bd7cecee674191b4efcc9575a1ceb8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Creating volume c737df55-0c0f-4420-8c7c-fa91c19e2dd9 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:24:13 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:24:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:13 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 1073741824 Jul 06 21:24:13 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:14 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 1073741824" returned: 0 in 0.822s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:14 devstack sudo[103818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 Jul 06 21:24:14 devstack sudo[103818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:15 devstack sudo[103818]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9" returned: 0 in 0.664s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] <== create_volume: return (1545ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.547s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (510d7a2f-d953-49fe-904c-302c8baa4eab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e67630-7aac-4b7e-8699-94481f95bfad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:24:15 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Volume volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 (c737df55-0c0f-4420-8c7c-fa91c19e2dd9): created successfully Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1e67630-7aac-4b7e-8699-94481f95bfad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Flow 'volume_create_manager' (99b9efaf-4524-4fb6-b75a-4cd52c23a93f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:24:15 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a3d94914-4804-4258-8389-df57486892eb tempest-ProjectReaderTests-1454297232 None] Created volume successfully. Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-c737df55-0c0f-4420-8c7c-fa91c19e2dd9-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Lock "cinder-c737df55-0c0f-4420-8c7c-fa91c19e2dd9-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Acquiring lock "cinder-quobyte-c737df55-0c0f-4420-8c7c-fa91c19e2dd9" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-c737df55-0c0f-4420-8c7c-fa91c19e2dd9" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bd4a748-050f-4241-8159-86c2c0917c3c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:24:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:16 devstack sudo[103821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 Jul 06 21:24:16 devstack sudo[103821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:16 devstack sudo[103821]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9" returned: 0 in 0.782s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:16 devstack sudo[103826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9 Jul 06 21:24:16 devstack sudo[103826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:17 devstack sudo[103826]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c737df55-0c0f-4420-8c7c-fa91c19e2dd9" returned: 0 in 0.681s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Lock "cinder-quobyte-c737df55-0c0f-4420-8c7c-fa91c19e2dd9" released by "delete_volume" :: held 1.510s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Created reservations ['5cd6f420-d202-487f-ac26-8d8a2fa7d2e3', 'dc774455-bd47-4b13-bfb6-92742e58b1f0', 'b298626c-3e60-44d6-bf24-f257bac99ceb', '7306dc82-c333-49d4-b16f-f63902292e9a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:17 devstack sudo[103908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:24:17 devstack sudo[103908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:18 devstack sudo[103908]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.711s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:18 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:24:18 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Deleted volume successfully. Jul 06 21:24:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-14524f7e-9b10-4b78-977f-e1f26d1da0df tempest-ProjectReaderTests-1454297232 None] Lock "cinder-c737df55-0c0f-4420-8c7c-fa91c19e2dd9-delete_volume" released by "delete_volume" :: held 2.464s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:27 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=75,cinder:INSERT=33,cinder:UPDATE=87,cinder:DELETE=7 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:24:28 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:INSERT=25,cinder:UPDATE=94,cinder:SELECT=69,cinder:DELETE=8 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:24:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-82cd6329-e53e-4c53-b748-b40fd86a336a req-09c512a1-1148-4bf8-8e5b-bd47713cd9f2 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-82cd6329-e53e-4c53-b748-b40fd86a336a req-09c512a1-1148-4bf8-8e5b-bd47713cd9f2 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:34 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2d16c-a3a3-4ad1-a087-214babf3ccac]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:24:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-82cd6329-e53e-4c53-b748-b40fd86a336a req-09c512a1-1148-4bf8-8e5b-bd47713cd9f2 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:34 devstack sudo[103952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd Jul 06 21:24:34 devstack sudo[103952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:34 devstack sudo[103952]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-82cd6329-e53e-4c53-b748-b40fd86a336a req-09c512a1-1148-4bf8-8e5b-bd47713cd9f2 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd" returned: 0 in 0.784s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-82cd6329-e53e-4c53-b748-b40fd86a336a req-09c512a1-1148-4bf8-8e5b-bd47713cd9f2 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.801s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-82cd6329-e53e-4c53-b748-b40fd86a336a req-09c512a1-1148-4bf8-8e5b-bd47713cd9f2 tempest-TestInstancesWithCinderVolumes-1175741813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eb44408e-6623-48f0-b3a1-ff259b01d9f9', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:24:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-82cd6329-e53e-4c53-b748-b40fd86a336a req-09c512a1-1148-4bf8-8e5b-bd47713cd9f2 tempest-TestInstancesWithCinderVolumes-1175741813 None] attachment_update completed successfully. Jul 06 21:24:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-e0e5077f-9f52-465f-a6dd-8211314e673a req-580096da-c0a7-43f5-99f0-8b998cb991c3 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-e0e5077f-9f52-465f-a6dd-8211314e673a req-580096da-c0a7-43f5-99f0-8b998cb991c3 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b809970-ddb3-4b99-ae14-fd38d262dfa3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:24:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e0e5077f-9f52-465f-a6dd-8211314e673a req-580096da-c0a7-43f5-99f0-8b998cb991c3 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:43 devstack sudo[103979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 Jul 06 21:24:43 devstack sudo[103979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:43 devstack sudo[103979]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-e0e5077f-9f52-465f-a6dd-8211314e673a req-580096da-c0a7-43f5-99f0-8b998cb991c3 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-e0e5077f-9f52-465f-a6dd-8211314e673a req-580096da-c0a7-43f5-99f0-8b998cb991c3 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.791s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-e0e5077f-9f52-465f-a6dd-8211314e673a req-580096da-c0a7-43f5-99f0-8b998cb991c3 tempest-TestInstancesWithCinderVolumes-1175741813 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '68fa68a6-2b5f-40c8-876f-5826062fcf62', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:24:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-e0e5077f-9f52-465f-a6dd-8211314e673a req-580096da-c0a7-43f5-99f0-8b998cb991c3 tempest-TestInstancesWithCinderVolumes-1175741813 None] attachment_update completed successfully. Jul 06 21:24:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-52f1fb71-4a20-4508-aa81-b9a6254625f8 req-a9ce6b7a-2351-4ce8-9617-61aa91147862 tempest-TestInstancesWithCinderVolumes-1175741813 None] Terminate volume connection completed successfully. Jul 06 21:24:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-52f1fb71-4a20-4508-aa81-b9a6254625f8 req-a9ce6b7a-2351-4ce8-9617-61aa91147862 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deleting attachment eb44408e-6623-48f0-b3a1-ff259b01d9f9. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:24:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "cinder-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:53 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=9,cinder:UPDATE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:24:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "cinder-quobyte-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:24:53 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-quobyte-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:24:53 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0072fff-46cf-4906-9591-f8f0a425be14]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:24:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:54 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd Jul 06 21:24:54 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:54 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd" returned: 0 in 0.791s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:54 devstack sudo[104064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd Jul 06 21:24:54 devstack sudo[104064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:55 devstack sudo[104064]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd" returned: 0 in 0.664s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-quobyte-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd" released by "delete_volume" :: held 1.498s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:55 devstack cinder-volume[87273]: WARNING cinder.quota [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2069189393-1962118840 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2069189393-1962118840, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:24:55 devstack cinder-volume[87273]: WARNING cinder.quota [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2069189393-1962118840 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2069189393-1962118840, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Created reservations ['b9270956-119c-4f2c-9434-0fd66f67e646', '87d1654b-bc51-43cd-989d-0de63acb44f8', 'fee09ae0-bc77-4f0b-9c2d-afef5a2f7cbc', '6dd9e147-f4d4-4d95-8409-71f874d17cb8'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:24:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:24:55 devstack sudo[104069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:24:55 devstack sudo[104069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:24:56 devstack sudo[104069]: pam_unix(sudo:session): session closed for user root Jul 06 21:24:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:24:56 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:24:56 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deleted volume successfully. Jul 06 21:24:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2e38539-fea8-42ca-90de-984dfc62ed97 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-1e7a934f-6e9e-46b4-8d6b-a7c9dd835efd-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:24:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-c069f142-5676-4aea-bbd9-c4e4ceeddf6a req-b2dfc39e-54a6-49cc-be20-45dda65e766d tempest-TestInstancesWithCinderVolumes-1175741813 None] Terminate volume connection completed successfully. Jul 06 21:24:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-c069f142-5676-4aea-bbd9-c4e4ceeddf6a req-b2dfc39e-54a6-49cc-be20-45dda65e766d tempest-TestInstancesWithCinderVolumes-1175741813 None] Deleting attachment 68fa68a6-2b5f-40c8-876f-5826062fcf62. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "cinder-2cf02df8-b66f-44c3-8d9f-5ebceaf87956-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-2cf02df8-b66f-44c3-8d9f-5ebceaf87956-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "cinder-quobyte-2cf02df8-b66f-44c3-8d9f-5ebceaf87956" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-quobyte-2cf02df8-b66f-44c3-8d9f-5ebceaf87956" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3875243-f60e-48a6-b5cd-a5af537f947d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:00 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 Jul 06 21:25:00 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:00 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956" returned: 0 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:01 devstack sudo[104111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956 Jul 06 21:25:01 devstack sudo[104111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:01 devstack sudo[104114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:25:01 devstack sudo[104114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:01 devstack sudo[104111]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2cf02df8-b66f-44c3-8d9f-5ebceaf87956" returned: 0 in 0.697s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-quobyte-2cf02df8-b66f-44c3-8d9f-5ebceaf87956" released by "delete_volume" :: held 1.568s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:25:01 devstack cinder-volume[87273]: WARNING cinder.quota [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1426639915-907860769 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1426639915-907860769, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:25:01 devstack cinder-volume[87273]: WARNING cinder.quota [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1426639915-907860769 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1426639915-907860769, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Created reservations ['70a011ff-dda4-4d1a-8b64-60cfc4710765', '8400a347-af6e-4cff-b46e-7122c0359abb', '4d861213-c311-4ee2-b96e-64186cc66749', 'd777f529-e00d-4d48-9adb-2d5f59acc2f7'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:25:01 devstack sudo[104114]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:25:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:01 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:25:01 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:02 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.748s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:25:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Deleted volume successfully. Jul 06 21:25:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dd857491-a59c-4b83-924d-3fbc7d318f9e tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-2cf02df8-b66f-44c3-8d9f-5ebceaf87956-delete_volume" released by "delete_volume" :: held 2.587s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:25:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-0958c173-4a5e-4615-8ce5-35c8d56d1ea2 req-e27c4890-502e-4bd5-b898-2be92e012719 tempest-TestInstancesWithCinderVolumes-1175741813 None] Terminate volume connection completed successfully. Jul 06 21:25:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-0958c173-4a5e-4615-8ce5-35c8d56d1ea2 req-e27c4890-502e-4bd5-b898-2be92e012719 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deleting attachment 3a9c286f-b028-4a69-9e0a-b1bc12143cb7. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:25:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "cinder-97e02b54-7995-4f94-98b9-3259c4e7dc6b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:25:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-97e02b54-7995-4f94-98b9-3259c4e7dc6b-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:25:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "cinder-quobyte-97e02b54-7995-4f94-98b9-3259c4e7dc6b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:25:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-quobyte-97e02b54-7995-4f94-98b9-3259c4e7dc6b" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:25:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d91ed2b-d5bd-4391-8997-82d88fc8adce]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:25:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:09 devstack sudo[104482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:25:09 devstack sudo[104482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:10 devstack sudo[104482]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:10 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:25:10 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:11 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 1 in 0.759s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:25:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:11 devstack sudo[104491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b Jul 06 21:25:11 devstack sudo[104491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:12 devstack sudo[104491]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-97e02b54-7995-4f94-98b9-3259c4e7dc6b" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-quobyte-97e02b54-7995-4f94-98b9-3259c4e7dc6b" released by "delete_volume" :: held 2.230s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:25:12 devstack cinder-volume[87273]: WARNING cinder.quota [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611992518-1863549578 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611992518-1863549578, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:25:12 devstack cinder-volume[87273]: WARNING cinder.quota [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611992518-1863549578 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1611992518-1863549578, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Created reservations ['9c7107c3-6b72-475d-bfd6-cac7be125f1e', 'b10e3f0f-cbe9-4ad1-b69a-0e94ecd67185', '65114c4c-d5b2-4ca9-8be3-6ad754543fa5', '4cd2c929-77ee-498f-9d8d-d476c7e0a2a1'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:12 devstack sudo[104494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:25:12 devstack sudo[104494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:12 devstack sudo[104494]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.640s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:25:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Deleted volume successfully. Jul 06 21:25:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3b77ae07-fdb0-4d8c-9693-ee66aadcca62 tempest-TestInstancesWithCinderVolumes-1175741813 None] Lock "cinder-97e02b54-7995-4f94-98b9-3259c4e7dc6b-delete_volume" released by "delete_volume" :: held 3.067s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:25:22 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=37,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:25:22 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=12,cinder:INSERT=6,cinder:UPDATE=26,cinder:DELETE=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:25:49 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:25:49 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Flow 'volume_create_manager' (68cb6208-1e9a-4c92-80f8-b2e0bab7e895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f4fb8f-f422-42d2-9382-56618444d468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75f4fb8f-f422-42d2-9382-56618444d468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1806365571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91820f74-4fa5-4695-98a3-de18feba38d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87321321dca4d10861cc2df9a158555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:25:57Z,use_quota=True,user_id='6cf2917839b94d828d7317cc0c51b2d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0ab644-2639-4564-974f-e359df430f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0ab644-2639-4564-974f-e359df430f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63132323-3394-4b75-8c6d-84a626ccd29e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63132323-3394-4b75-8c6d-84a626ccd29e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '91820f74-4fa5-4695-98a3-de18feba38d0', 'volume_name': 'volume-91820f74-4fa5-4695-98a3-de18feba38d0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc04bcc-9936-40a6-8d48-a2ebfaef283e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc04bcc-9936-40a6-8d48-a2ebfaef283e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d61104f-90bb-4f1a-86fe-edc58fc752a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:25:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Volume 91820f74-4fa5-4695-98a3-de18feba38d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-91820f74-4fa5-4695-98a3-de18feba38d0', 'volume_size': 1} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:25:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1806365571',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=91820f74-4fa5-4695-98a3-de18feba38d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a87321321dca4d10861cc2df9a158555',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:25:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:25:57Z,use_quota=True,user_id='6cf2917839b94d828d7317cc0c51b2d7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Creating volume 91820f74-4fa5-4695-98a3-de18feba38d0 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:25:57 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:25:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:57 devstack sudo[104743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 1073741824 Jul 06 21:25:57 devstack sudo[104743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:58 devstack sudo[104743]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 1073741824" returned: 0 in 0.834s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:25:58 devstack sudo[104748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 Jul 06 21:25:58 devstack sudo[104748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:25:58 devstack sudo[104748]: pam_unix(sudo:session): session closed for user root Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0" returned: 0 in 0.669s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] <== create_volume: return (1543ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.545s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d61104f-90bb-4f1a-86fe-edc58fc752a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-91820f74-4fa5-4695-98a3-de18feba38d0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e335656a-67f2-4451-800d-d97a1f667ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:25:58 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Volume volume-91820f74-4fa5-4695-98a3-de18feba38d0 (91820f74-4fa5-4695-98a3-de18feba38d0): created successfully Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e335656a-67f2-4451-800d-d97a1f667ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:25:58 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Flow 'volume_create_manager' (68cb6208-1e9a-4c92-80f8-b2e0bab7e895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:25:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d14b5931-3292-4340-9d51-8670545739ce tempest-TestMinimumBasicScenario-1573030372 None] Created volume successfully. Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:26:01 devstack sudo[104758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:26:01 devstack sudo[104758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:26:01 devstack sudo[104758]: pam_unix(sudo:session): session closed for user root Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.716s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:26:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:26:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-303463d0-f656-4a35-ad10-394a42b5d0ec req-968daaba-1963-401c-9307-d0ceb6fa7560 tempest-TestMinimumBasicScenario-1573030372 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:26:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-303463d0-f656-4a35-ad10-394a42b5d0ec req-968daaba-1963-401c-9307-d0ceb6fa7560 tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:26:02 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3c48ba0-be9c-468e-9a29-bfdf5dde76b5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:26:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-303463d0-f656-4a35-ad10-394a42b5d0ec req-968daaba-1963-401c-9307-d0ceb6fa7560 tempest-TestMinimumBasicScenario-1573030372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:26:02 devstack sudo[104769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 Jul 06 21:26:02 devstack sudo[104769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:26:03 devstack sudo[104769]: pam_unix(sudo:session): session closed for user root Jul 06 21:26:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-303463d0-f656-4a35-ad10-394a42b5d0ec req-968daaba-1963-401c-9307-d0ceb6fa7560 tempest-TestMinimumBasicScenario-1573030372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0" returned: 0 in 0.753s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:26:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-303463d0-f656-4a35-ad10-394a42b5d0ec req-968daaba-1963-401c-9307-d0ceb6fa7560 tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.769s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:26:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-303463d0-f656-4a35-ad10-394a42b5d0ec req-968daaba-1963-401c-9307-d0ceb6fa7560 tempest-TestMinimumBasicScenario-1573030372 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-91820f74-4fa5-4695-98a3-de18feba38d0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ee08b529-0426-4002-9f22-e716a6801f00', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:26:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-303463d0-f656-4a35-ad10-394a42b5d0ec req-968daaba-1963-401c-9307-d0ceb6fa7560 tempest-TestMinimumBasicScenario-1573030372 None] attachment_update completed successfully. Jul 06 21:26:13 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=4,cinder:SELECT=6,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:26:13 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:26:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-8f1c12f4-0b03-490f-94a8-9366d6311483 req-e56f1c3f-2cad-468e-8d59-1561f71d428d tempest-TestMinimumBasicScenario-1573030372 None] Terminate volume connection completed successfully. Jul 06 21:26:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-8f1c12f4-0b03-490f-94a8-9366d6311483 req-e56f1c3f-2cad-468e-8d59-1561f71d428d tempest-TestMinimumBasicScenario-1573030372 None] Deleting attachment ee08b529-0426-4002-9f22-e716a6801f00. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:26:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Acquiring lock "cinder-91820f74-4fa5-4695-98a3-de18feba38d0-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:26:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Lock "cinder-91820f74-4fa5-4695-98a3-de18feba38d0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:26:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Acquiring lock "cinder-quobyte-91820f74-4fa5-4695-98a3-de18feba38d0" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:26:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Lock "cinder-quobyte-91820f74-4fa5-4695-98a3-de18feba38d0" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:26:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[144b9133-f5d8-4042-832d-62a502ba752e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:26:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:26:49 devstack sudo[105255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 Jul 06 21:26:49 devstack sudo[105255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:26:49 devstack sudo[105255]: pam_unix(sudo:session): session closed for user root Jul 06 21:26:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0" returned: 0 in 0.737s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:26:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:26:49 devstack sudo[105261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0 Jul 06 21:26:49 devstack sudo[105261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:26:50 devstack sudo[105261]: pam_unix(sudo:session): session closed for user root Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-91820f74-4fa5-4695-98a3-de18feba38d0" returned: 0 in 0.654s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Lock "cinder-quobyte-91820f74-4fa5-4695-98a3-de18feba38d0" released by "delete_volume" :: held 1.427s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Created reservations ['ae2e58d5-06e3-4d35-864e-b1486f04adb0', '2755e85e-484d-4ae3-8d37-898dc116fa3f', '6b0f31cc-c86f-4bad-97ae-595f28ca5799', '41fa66e8-e541-4e75-968d-317af2659c9a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:26:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:26:50 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:26:50 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:26:51 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Jul 06 21:26:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.632s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:26:51 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:26:51 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Deleted volume successfully. Jul 06 21:26:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-104a415b-ad11-4b39-8746-b30d2016bf7f tempest-TestMinimumBasicScenario-1573030372 None] Lock "cinder-91820f74-4fa5-4695-98a3-de18feba38d0-delete_volume" released by "delete_volume" :: held 2.250s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:27:00 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=6,cinder:UPDATE=7,cinder:INSERT=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=6,cinder:INSERT=2,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:27:01 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:27:01 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:27:01 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:27:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Flow 'volume_create_manager' (782c9b5b-b9b8-4a65-8f81-50e781d3ea63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddc728b-e2dc-468d-bacb-5bf1be700764) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fddc728b-e2dc-468d-bacb-5bf1be700764) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-102751761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d1d50a-52a1-47e1-9109-7fbfbe1d69bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1faad0e9b491e96b85fba34183f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:27:27Z,use_quota=True,user_id='394ef1448db448629ab5efcf1932154b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b777d78f-3fcc-4bec-9477-05100bb1e4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b777d78f-3fcc-4bec-9477-05100bb1e4ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385eed7-c1c8-4c3d-8579-fa318799643b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e385eed7-c1c8-4c3d-8579-fa318799643b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10d1d50a-52a1-47e1-9109-7fbfbe1d69bf', 'volume_name': 'volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db00a660-025a-49ef-84a0-361c3eb2e485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db00a660-025a-49ef-84a0-361c3eb2e485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1327980a-5d47-43cc-9e72-772ac80e43ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Volume 10d1d50a-52a1-47e1-9109-7fbfbe1d69bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf', 'volume_size': 1} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-102751761',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10d1d50a-52a1-47e1-9109-7fbfbe1d69bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1faad0e9b491e96b85fba34183f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:27:27Z,use_quota=True,user_id='394ef1448db448629ab5efcf1932154b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Creating volume 10d1d50a-52a1-47e1-9109-7fbfbe1d69bf {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:27:27 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:27:27 devstack sudo[105348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf 1073741824 Jul 06 21:27:27 devstack sudo[105348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Flow 'volume_create_manager' (c9fb614d-82d4-4707-a7ad-ba06f226ebf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b5acfc-d6aa-4be6-a1a4-54131e0aa36a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42b5acfc-d6aa-4be6-a1a4-54131e0aa36a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-928444745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a5e350-1242-4a01-bf9c-f814b421a743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1faad0e9b491e96b85fba34183f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:27:27Z,use_quota=True,user_id='394ef1448db448629ab5efcf1932154b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303e0f40-08f2-4e19-9be8-cc11a2046442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (303e0f40-08f2-4e19-9be8-cc11a2046442) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d020a8-d566-4e5b-bf2d-91b7a399186a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6d020a8-d566-4e5b-bf2d-91b7a399186a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e4a5e350-1242-4a01-bf9c-f814b421a743', 'volume_name': 'volume-e4a5e350-1242-4a01-bf9c-f814b421a743', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd118d2-32da-4d13-8ab6-8f2a6363a179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6bd118d2-32da-4d13-8ab6-8f2a6363a179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368a3aef-e374-49c7-9e2b-05b8b308fa05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:27 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Volume e4a5e350-1242-4a01-bf9c-f814b421a743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e4a5e350-1242-4a01-bf9c-f814b421a743', 'volume_size': 1} Jul 06 21:27:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:27:28 devstack sudo[105348]: pam_unix(sudo:session): session closed for user root Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf 1073741824" returned: 0 in 0.887s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:27:28 devstack sudo[105354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf Jul 06 21:27:28 devstack sudo[105354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:27:28 devstack sudo[105354]: pam_unix(sudo:session): session closed for user root Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] <== create_volume: return (1583ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.231s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:27:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-928444745',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e4a5e350-1242-4a01-bf9c-f814b421a743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5cb1faad0e9b491e96b85fba34183f83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:27:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:27:27Z,use_quota=True,user_id='394ef1448db448629ab5efcf1932154b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Creating volume e4a5e350-1242-4a01-bf9c-f814b421a743 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:27:28 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1327980a-5d47-43cc-9e72-772ac80e43ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:28 devstack sudo[105357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 1073741824 Jul 06 21:27:28 devstack sudo[105357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0141cdf4-397d-431a-b53d-6137104916f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Volume volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf (10d1d50a-52a1-47e1-9109-7fbfbe1d69bf): created successfully Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0141cdf4-397d-431a-b53d-6137104916f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Flow 'volume_create_manager' (782c9b5b-b9b8-4a65-8f81-50e781d3ea63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:27:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8627f8a9-0e03-4480-a171-3f7ef6b921f7 tempest-TestServerVolumeAttachmentScenario-429511816 None] Created volume successfully. Jul 06 21:27:29 devstack sudo[105357]: pam_unix(sudo:session): session closed for user root Jul 06 21:27:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 1073741824" returned: 0 in 0.863s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:27:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:27:29 devstack sudo[105363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 Jul 06 21:27:29 devstack sudo[105363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:27:30 devstack sudo[105363]: pam_unix(sudo:session): session closed for user root Jul 06 21:27:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743" returned: 0 in 0.660s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:27:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] <== create_volume: return (1581ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:27:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.584s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:27:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (368a3aef-e374-49c7-9e2b-05b8b308fa05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e4a5e350-1242-4a01-bf9c-f814b421a743', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632ee9f9-c064-4566-8512-42003ddc9d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:27:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Volume volume-e4a5e350-1242-4a01-bf9c-f814b421a743 (e4a5e350-1242-4a01-bf9c-f814b421a743): created successfully Jul 06 21:27:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (632ee9f9-c064-4566-8512-42003ddc9d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:27:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Flow 'volume_create_manager' (c9fb614d-82d4-4707-a7ad-ba06f226ebf6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:27:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-22cff8b7-bd4f-453a-af36-42ef45b19802 tempest-TestServerVolumeAttachmentScenario-429511816 None] Created volume successfully. Jul 06 21:27:49 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=4,cinder:UPDATE=4,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:27:49 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=9,cinder:SELECT=5,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:01 devstack sudo[105527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:28:01 devstack sudo[105527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:01 devstack sudo[105527]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.694s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:28:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:28:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-84153661-ba6c-4be6-b549-70b4130ccd2e req-0d1a9e9c-50de-4996-aa31-d4ef56024dd5 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:28:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-84153661-ba6c-4be6-b549-70b4130ccd2e req-0d1a9e9c-50de-4996-aa31-d4ef56024dd5 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:28:08 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9ec3e12-d420-42c3-ae83-831339a9b3c1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:28:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-84153661-ba6c-4be6-b549-70b4130ccd2e req-0d1a9e9c-50de-4996-aa31-d4ef56024dd5 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:08 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf Jul 06 21:28:08 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:09 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-84153661-ba6c-4be6-b549-70b4130ccd2e req-0d1a9e9c-50de-4996-aa31-d4ef56024dd5 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-84153661-ba6c-4be6-b549-70b4130ccd2e req-0d1a9e9c-50de-4996-aa31-d4ef56024dd5 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.771s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:28:09 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-84153661-ba6c-4be6-b549-70b4130ccd2e req-0d1a9e9c-50de-4996-aa31-d4ef56024dd5 tempest-TestServerVolumeAttachmentScenario-429511816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd5c518e0-57ff-4288-937e-435c04297e0c', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:28:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-84153661-ba6c-4be6-b549-70b4130ccd2e req-0d1a9e9c-50de-4996-aa31-d4ef56024dd5 tempest-TestServerVolumeAttachmentScenario-429511816 None] attachment_update completed successfully. Jul 06 21:28:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-b2326f0b-50fa-4dd5-85c1-4f09f546b781 req-688d78ae-b302-40dd-a389-71d2804b3ea1 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:28:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-b2326f0b-50fa-4dd5-85c1-4f09f546b781 req-688d78ae-b302-40dd-a389-71d2804b3ea1 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:28:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f76076-1498-4612-a431-2f58454b297d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:28:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-b2326f0b-50fa-4dd5-85c1-4f09f546b781 req-688d78ae-b302-40dd-a389-71d2804b3ea1 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:18 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 Jul 06 21:28:18 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:19 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [req-b2326f0b-50fa-4dd5-85c1-4f09f546b781 req-688d78ae-b302-40dd-a389-71d2804b3ea1 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743" returned: 0 in 0.764s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [req-b2326f0b-50fa-4dd5-85c1-4f09f546b781 req-688d78ae-b302-40dd-a389-71d2804b3ea1 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.780s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:28:19 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-b2326f0b-50fa-4dd5-85c1-4f09f546b781 req-688d78ae-b302-40dd-a389-71d2804b3ea1 tempest-TestServerVolumeAttachmentScenario-429511816 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f', 'name': 'volume-e4a5e350-1242-4a01-bf9c-f814b421a743', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '79c7eb37-ba91-4a6f-bf97-6f3d9dd9d9ae', 'enforce_multipath': True} {{(pid=87273) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Jul 06 21:28:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-b2326f0b-50fa-4dd5-85c1-4f09f546b781 req-688d78ae-b302-40dd-a389-71d2804b3ea1 tempest-TestServerVolumeAttachmentScenario-429511816 None] attachment_update completed successfully. Jul 06 21:28:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-cbe856bb-27fd-47c6-a53a-41afe17c557c req-e8f9df40-293e-4f35-b589-767355e48148 tempest-TestServerVolumeAttachmentScenario-429511816 None] Terminate volume connection completed successfully. Jul 06 21:28:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-cbe856bb-27fd-47c6-a53a-41afe17c557c req-e8f9df40-293e-4f35-b589-767355e48148 tempest-TestServerVolumeAttachmentScenario-429511816 None] Deleting attachment 79c7eb37-ba91-4a6f-bf97-6f3d9dd9d9ae. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:28:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [req-b71a0695-ae2e-4d8f-8a05-effd84e501b5 req-6c2d1277-b7c6-4a87-9ffb-b790f6ebd830 tempest-TestServerVolumeAttachmentScenario-429511816 None] Terminate volume connection completed successfully. Jul 06 21:28:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [req-b71a0695-ae2e-4d8f-8a05-effd84e501b5 req-6c2d1277-b7c6-4a87-9ffb-b790f6ebd830 tempest-TestServerVolumeAttachmentScenario-429511816 None] Deleting attachment d5c518e0-57ff-4288-937e-435c04297e0c. {{(pid=87273) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=15,cinder:UPDATE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "cinder-e4a5e350-1242-4a01-bf9c-f814b421a743-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-e4a5e350-1242-4a01-bf9c-f814b421a743-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "cinder-quobyte-e4a5e350-1242-4a01-bf9c-f814b421a743" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-quobyte-e4a5e350-1242-4a01-bf9c-f814b421a743" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[750268f0-6d21-49ea-982b-d107d1039ead]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:28:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:39 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 Jul 06 21:28:39 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:39 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743" returned: 0 in 0.743s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:39 devstack sudo[106015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743 Jul 06 21:28:39 devstack sudo[106015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:40 devstack sudo[106015]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e4a5e350-1242-4a01-bf9c-f814b421a743" returned: 0 in 0.635s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-quobyte-e4a5e350-1242-4a01-bf9c-f814b421a743" released by "delete_volume" :: held 1.420s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Created reservations ['33c02d07-d622-42fd-b919-96636a26607b', 'c988d6df-cf94-4a1b-b0a2-649a9f6c1359', '3c5bac80-5880-4fd6-8190-df05e52b4fde', '572020e2-ebef-47f2-8c06-40ef01fe1b3c'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:28:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:40 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:28:40 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "cinder-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:28:41 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:28:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Deleted volume successfully. Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2d73df17-82d6-4bf9-a420-e9684fdcdf23 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-e4a5e350-1242-4a01-bf9c-f814b421a743-delete_volume" released by "delete_volume" :: held 2.271s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "cinder-quobyte-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-quobyte-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2399d7ea-314f-47e5-9ae0-f5db2804603d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:41 devstack sudo[106021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf Jul 06 21:28:41 devstack sudo[106021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:41 devstack sudo[106021]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf" returned: 0 in 0.745s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:41 devstack sudo[106026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf Jul 06 21:28:41 devstack sudo[106026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:42 devstack sudo[106026]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf" returned: 0 in 0.646s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-quobyte-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf" released by "delete_volume" :: held 1.425s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Created reservations ['ac648c7a-3dd1-4a12-9b53-f128e5ded829', '900f9a2b-8fe8-4205-ae97-0966e84329e0', '831f8cec-cf3f-482b-af81-424262a53832', '7a6131c3-2fd2-41d5-bae0-1e5c4fd56e3d'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:28:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:42 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:28:42 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:43 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:43 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:28:43 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Deleted volume successfully. Jul 06 21:28:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85a2bddd-4b10-45f6-83b0-73f678d72d72 tempest-TestServerVolumeAttachmentScenario-429511816 None] Lock "cinder-10d1d50a-52a1-47e1-9109-7fbfbe1d69bf-delete_volume" released by "delete_volume" :: held 2.273s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:28:52 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=14,cinder:SELECT=10,cinder:INSERT=5 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:28:53 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=10,cinder:INSERT=3,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Flow 'volume_create_manager' (6d37c15d-0b56-43eb-bc65-db1e804067ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c9c77b-5aa3-4c09-b876-71a0be0834f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92c9c77b-5aa3-4c09-b876-71a0be0834f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d143bde-2be5-44a9-a1b9-4e86b4523829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc7f306a81403ea46e9f40c4e9a16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:28:55Z,use_quota=True,user_id='6937f0af6c2e49a18361a0580263492a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1ef752e-e195-4f21-93b8-0c897cf5b5c0),volume_type_id=d1ef752e-e195-4f21-93b8-0c897cf5b5c0)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f148f6-f7c4-4c47-b7c7-7f1232702468) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9f148f6-f7c4-4c47-b7c7-7f1232702468) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea59bad-0757-46d6-8c38-7692150b65ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fea59bad-0757-46d6-8c38-7692150b65ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '1d143bde-2be5-44a9-a1b9-4e86b4523829', 'volume_name': 'volume-1d143bde-2be5-44a9-a1b9-4e86b4523829', 'volume_size': 1, 'image_id': 'a13c666d-94ae-43f2-9889-35db8040af7b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a13c666d-94ae-43f2-9889-35db8040af7b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ab5e6b494f69458dcd7ec451740164a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4edc7f306a81403ea46e9f40c4e9a16a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff52d43c87577feae26d01c96b5f5c95548a674dc883fcadb5b61c98a1d69b9bb6641fa6034afc18e7f1012c023fc849f90f3591b6c6ef28ac58c8cc868186ce', 'id': 'a13c666d-94ae-43f2-9889-35db8040af7b', 'created_at': datetime.datetime(2026, 7, 6, 19, 28, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 28, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a13c666d-94ae-43f2-9889-35db8040af7b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9c164a-8c0e-454e-b975-2bbf447aecb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cb9c164a-8c0e-454e-b975-2bbf447aecb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be42669f-fe5c-42a3-817c-a03e9916ec1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:28:55 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Volume 1d143bde-2be5-44a9-a1b9-4e86b4523829: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-1d143bde-2be5-44a9-a1b9-4e86b4523829', 'volume_size': 1, 'image_id': 'a13c666d-94ae-43f2-9889-35db8040af7b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a13c666d-94ae-43f2-9889-35db8040af7b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ab5e6b494f69458dcd7ec451740164a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4edc7f306a81403ea46e9f40c4e9a16a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff52d43c87577feae26d01c96b5f5c95548a674dc883fcadb5b61c98a1d69b9bb6641fa6034afc18e7f1012c023fc849f90f3591b6c6ef28ac58c8cc868186ce', 'id': 'a13c666d-94ae-43f2-9889-35db8040af7b', 'created_at': datetime.datetime(2026, 7, 6, 19, 28, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 28, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a13c666d-94ae-43f2-9889-35db8040af7b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Trying to clone 1d143bde-2be5-44a9-a1b9-4e86b4523829 from image a13c666d-94ae-43f2-9889-35db8040af7b at location (None, [{'url': 'file:///opt/stack/data/glance/images/a13c666d-94ae-43f2-9889-35db8040af7b', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:28:55 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:28:55 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Image download 0.00 MB at 0.00 MB/s Jul 06 21:28:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5d67465-4f5a-4b34-b5a9-78297ca89d37]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:28:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:56 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD Jul 06 21:28:56 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:56 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD" returned: 0 in 0.746s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:56 devstack sudo[106080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD Jul 06 21:28:56 devstack sudo[106080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:57 devstack sudo[106080]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD" returned: 1 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:28:57 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Temporary image a13c666d-94ae-43f2-9889-35db8040af7b is fetched for user 6937f0af6c2e49a18361a0580263492a. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:28:57 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[39e48537-cc4f-49c7-b4af-2d38d46a0d66]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:28:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:57 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD Jul 06 21:28:57 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:58 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD" returned: 0 in 0.734s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:58 devstack sudo[106096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD Jul 06 21:28:58 devstack sudo[106096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:59 devstack sudo[106096]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD" returned: 1 in 0.732s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d143bde-2be5-44a9-a1b9-4e86b4523829,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4edc7f306a81403ea46e9f40c4e9a16a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:28:55Z,use_quota=True,user_id='6937f0af6c2e49a18361a0580263492a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d1ef752e-e195-4f21-93b8-0c897cf5b5c0),volume_type_id=d1ef752e-e195-4f21-93b8-0c897cf5b5c0)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Creating volume 1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:28:59 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:59 devstack sudo[106104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 1073741824 Jul 06 21:28:59 devstack sudo[106104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:28:59 devstack sudo[106104]: pam_unix(sudo:session): session closed for user root Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 1073741824" returned: 0 in 0.801s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:28:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:28:59 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 Jul 06 21:28:59 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:00 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829" returned: 0 in 0.630s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] <== create_volume: return (1470ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:29:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.472s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:00 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Attempting download of a13c666d-94ae-43f2-9889-35db8040af7b ((None, [{'url': 'file:///opt/stack/data/glance/images/a13c666d-94ae-43f2-9889-35db8040af7b', 'metadata': {}}])) to volume 1d143bde-2be5-44a9-a1b9-4e86b4523829. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:29:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a73badd-df7d-423d-b487-1f00fb8ed9fb]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a13c666d-94ae-43f2-9889-35db8040af7b_x7rj6ly5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:00 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a13c666d-94ae-43f2-9889-35db8040af7b_x7rj6ly5 Jul 06 21:29:00 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:01 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:01 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:01 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_a13c666d-94ae-43f2-9889-35db8040af7b_x7rj6ly5" returned: 0 in 0.729s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13c666d-94ae-43f2-9889-35db8040af7b_x7rj6ly5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:01 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13c666d-94ae-43f2-9889-35db8040af7b_x7rj6ly5 Jul 06 21:29:01 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:01 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:29:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:29:02 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13c666d-94ae-43f2-9889-35db8040af7b_x7rj6ly5" returned: 1 in 0.733s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_a13c666d-94ae-43f2-9889-35db8040af7b_x7rj6ly5' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:29:02 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2c3785c-e17b-4571-bd7c-c2bb3e9e8eb8]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:02 devstack sudo[106124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD Jul 06 21:29:02 devstack sudo[106124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:02 devstack sudo[106124]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD" returned: 0 in 0.718s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:02 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD Jul 06 21:29:02 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:03 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD" returned: 1 in 0.724s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:29:03 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] a13c666d-94ae-43f2-9889-35db8040af7b was raw, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:29:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:03 devstack sudo[106134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 Jul 06 21:29:03 devstack sudo[106134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:04 devstack sudo[106134]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829" returned: 0 in 0.734s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:04 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_a13c666d-94ae-43f2-9889-35db8040af7b_ol7pxidmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:29:04 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 21:29:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:04 devstack sudo[106139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 1G Jul 06 21:29:04 devstack sudo[106139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:04 devstack sudo[106139]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 1G" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:04 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[12a239f5-62aa-4955-a2e1-d83bcb9ca37e]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:05 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 Jul 06 21:29:05 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:05 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829" returned: 0 in 0.727s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:05 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 Jul 06 21:29:05 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:06 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829" returned: 1 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Downloaded image a13c666d-94ae-43f2-9889-35db8040af7b ((None, [{'url': 'file:///opt/stack/data/glance/images/a13c666d-94ae-43f2-9889-35db8040af7b', 'metadata': {}}])) to volume 1d143bde-2be5-44a9-a1b9-4e86b4523829 successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Temporary image a13c666d-94ae-43f2-9889-35db8040af7b for user 6937f0af6c2e49a18361a0580263492a is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Marking volume 1d143bde-2be5-44a9-a1b9-4e86b4523829 as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Copying metadata from image a13c666d-94ae-43f2-9889-35db8040af7b to 1d143bde-2be5-44a9-a1b9-4e86b4523829. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Creating volume glance metadata for volume 1d143bde-2be5-44a9-a1b9-4e86b4523829 backed by image a13c666d-94ae-43f2-9889-35db8040af7b with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'a13c666d-94ae-43f2-9889-35db8040af7b', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '6ab5e6b494f69458dcd7ec451740164a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (be42669f-fe5c-42a3-817c-a03e9916ec1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d143bde-2be5-44a9-a1b9-4e86b4523829', 'volume_size': 1, 'image_id': 'a13c666d-94ae-43f2-9889-35db8040af7b', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/a13c666d-94ae-43f2-9889-35db8040af7b', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '6ab5e6b494f69458dcd7ec451740164a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '4edc7f306a81403ea46e9f40c4e9a16a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'ff52d43c87577feae26d01c96b5f5c95548a674dc883fcadb5b61c98a1d69b9bb6641fa6034afc18e7f1012c023fc849f90f3591b6c6ef28ac58c8cc868186ce', 'id': 'a13c666d-94ae-43f2-9889-35db8040af7b', 'created_at': datetime.datetime(2026, 7, 6, 19, 28, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 28, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/a13c666d-94ae-43f2-9889-35db8040af7b/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f3d3f3-dfa6-4791-abcf-09e308f46358) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:06 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Volume volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 (1d143bde-2be5-44a9-a1b9-4e86b4523829): created successfully Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0f3d3f3-dfa6-4791-abcf-09e308f46358) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Flow 'volume_create_manager' (6d37c15d-0b56-43eb-bc65-db1e804067ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-90588bcd-abf9-4f5a-8430-7d9dea8cb257 tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Created volume successfully. Jul 06 21:29:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Acquiring lock "cinder-1d143bde-2be5-44a9-a1b9-4e86b4523829-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "cinder-1d143bde-2be5-44a9-a1b9-4e86b4523829-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Acquiring lock "cinder-quobyte-1d143bde-2be5-44a9-a1b9-4e86b4523829" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "cinder-quobyte-1d143bde-2be5-44a9-a1b9-4e86b4523829" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:07 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6950fb7-609b-4fb0-a9fc-559d61e332db]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:07 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 Jul 06 21:29:07 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:08 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829" returned: 0 in 0.769s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:08 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 Jul 06 21:29:08 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:08 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829" returned: 1 in 0.724s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:29:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:08 devstack sudo[106162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829 Jul 06 21:29:08 devstack sudo[106162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:09 devstack sudo[106162]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1d143bde-2be5-44a9-a1b9-4e86b4523829" returned: 0 in 0.646s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "cinder-quobyte-1d143bde-2be5-44a9-a1b9-4e86b4523829" released by "delete_volume" :: held 2.195s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:09 devstack cinder-volume[87273]: WARNING cinder.quota [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:29:09 devstack cinder-volume[87273]: WARNING cinder.quota [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Created reservations ['9fc7c8d6-66ca-4fb7-834e-a2e08d51790d', '0d6ea821-6dcd-4ea7-a578-482015ebc144', '69897e24-58f3-468f-ae91-56310985605c', '3dc183fa-6731-4ec4-8791-14c6183c69dd'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:09 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:09 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:10 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.639s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:10 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:10 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Deleted volume successfully. Jul 06 21:29:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ce65cf4d-1889-42c3-9262-817684d46b7b tempest-VolumeAndVolumeTypeFromImageTest-1350617187 None] Lock "cinder-1d143bde-2be5-44a9-a1b9-4e86b4523829-delete_volume" released by "delete_volume" :: held 3.018s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (6b82a400-5d27-41c8-b96d-6aa9bb3d9fe4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad48292-515e-4d64-bb29-af9764269a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ad48292-515e-4d64-bb29-af9764269a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343762188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:14Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19607059-aca6-4fc6-bf8f-8c43f27f52d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19607059-aca6-4fc6-bf8f-8c43f27f52d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68874919-dadd-4717-9c8e-91ad67763130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68874919-dadd-4717-9c8e-91ad67763130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0', 'volume_name': 'volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555cc153-2718-4099-9462-d9b5bd4dcb0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (555cc153-2718-4099-9462-d9b5bd4dcb0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f57877-5cd4-431c-a998-963b9072bb78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:14 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume 6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0', 'volume_size': 1} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-343762188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:14Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Creating volume 6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:29:14 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:29:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:14 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 1073741824 Jul 06 21:29:14 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:15 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 1073741824" returned: 0 in 0.797s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:15 devstack sudo[106175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 Jul 06 21:29:15 devstack sudo[106175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:15 devstack sudo[106175]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" returned: 0 in 0.634s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] <== create_volume: return (1472ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:29:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.475s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6f57877-5cd4-431c-a998-963b9072bb78) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb4ec6c-0c4a-4417-8da3-36ff1000c4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:16 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 (6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0): created successfully Jul 06 21:29:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (edb4ec6c-0c4a-4417-8da3-36ff1000c4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:16 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (6b82a400-5d27-41c8-b96d-6aa9bb3d9fe4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:16 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-21dab3e0-0585-4dc8-8451-ab2be9a9a440 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created volume successfully. Jul 06 21:29:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Creating offline snapshot 7bc269ea-babf-422e-ba7f-4a062e86adfb of volume 6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:29:16 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c463ba26-a19c-4a85-a315-8aa47d496334]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:16 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 Jul 06 21:29:16 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:17 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" returned: 0 in 0.754s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:17 devstack sudo[106183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb 1G Jul 06 21:29:17 devstack sudo[106183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:18 devstack sudo[106183]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb 1G" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:18 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb Jul 06 21:29:18 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:18 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:18 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb is being set with open permissions: ugo+rw Jul 06 21:29:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:18 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb Jul 06 21:29:18 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:19 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb" returned: 0 in 0.629s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:19 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.info Jul 06 21:29:19 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:20 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.info" returned: 0 in 0.637s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:20 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.info is being set with open permissions: ugo+rw Jul 06 21:29:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:20 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.info Jul 06 21:29:20 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:20 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.info" returned: 0 in 0.636s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.185s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-cf8a9e84-cee4-4441-bf0a-512a680c470e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Create snapshot completed successfully Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (f61f096d-5143-484f-882c-17956ceeb0d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f82b79-3e10-4445-a717-d8852760d3e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63f82b79-3e10-4445-a717-d8852760d3e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546492788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114510d8-9195-4850-a234-ba44ecbb91c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:22Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70ac2d0-3ae6-49c6-a8fb-40715d159229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70ac2d0-3ae6-49c6-a8fb-40715d159229) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1a1daa-ce06-4e5e-8604-6c6324eea8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e1a1daa-ce06-4e5e-8604-6c6324eea8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '114510d8-9195-4850-a234-ba44ecbb91c3', 'volume_name': 'volume-114510d8-9195-4850-a234-ba44ecbb91c3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41594ae5-69d8-48d0-ba53-85e96dc82433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41594ae5-69d8-48d0-ba53-85e96dc82433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651c3881-8496-47c0-b8af-34fb64ac4d4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume 114510d8-9195-4850-a234-ba44ecbb91c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-114510d8-9195-4850-a234-ba44ecbb91c3', 'volume_size': 1} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1546492788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=114510d8-9195-4850-a234-ba44ecbb91c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:22Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Creating volume 114510d8-9195-4850-a234-ba44ecbb91c3 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:29:22 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:22 devstack sudo[106203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 1073741824 Jul 06 21:29:22 devstack sudo[106203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (ca753fec-56fe-4dca-8c0b-8e7d6de03cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4658d803-9851-48cd-94d8-ea92e60dcce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4658d803-9851-48cd-94d8-ea92e60dcce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801034074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd92e6d-4870-409c-a5a3-1d33e3e77046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:23Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c68a963-9ef7-4543-9b4a-2ce0c81e7be3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c68a963-9ef7-4543-9b4a-2ce0c81e7be3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac192d4f-9342-401c-85b0-dc4e5f6b5443) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac192d4f-9342-401c-85b0-dc4e5f6b5443) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbd92e6d-4870-409c-a5a3-1d33e3e77046', 'volume_name': 'volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88cff58-dab4-4385-8de0-216b02f120bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d88cff58-dab4-4385-8de0-216b02f120bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33334ff-bf3a-4f11-97e1-3305cc3cd828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:22 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume dbd92e6d-4870-409c-a5a3-1d33e3e77046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046', 'volume_size': 1} Jul 06 21:29:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (81c522d6-1273-4463-b600-55d41041715d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d6778e-db30-4061-8c6f-6497ffa8cdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96d6778e-db30-4061-8c6f-6497ffa8cdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681645635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14812f3-a46d-44ce-aab7-f6273c17d332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:23Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb7f2e8-98ce-4579-895d-642c8d38f984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3bb7f2e8-98ce-4579-895d-642c8d38f984) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ade0a5-5c8e-4769-9ece-f2e1af62961b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09ade0a5-5c8e-4769-9ece-f2e1af62961b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f14812f3-a46d-44ce-aab7-f6273c17d332', 'volume_name': 'volume-f14812f3-a46d-44ce-aab7-f6273c17d332', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2380a7c7-b276-4a70-b2c9-3bf77d482d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2380a7c7-b276-4a70-b2c9-3bf77d482d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac01b98d-db9e-43a7-a240-c793dddda59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume f14812f3-a46d-44ce-aab7-f6273c17d332: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f14812f3-a46d-44ce-aab7-f6273c17d332', 'volume_size': 1} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:23 devstack sudo[106203]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 1073741824" returned: 0 in 0.951s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:23 devstack sudo[106209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 Jul 06 21:29:23 devstack sudo[106209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (68c8895e-66c2-4699-81ef-27c91048f816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c11f639-0096-4420-8d36-553d20c65c22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c11f639-0096-4420-8d36-553d20c65c22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332650142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1784a9f-3dce-4334-8beb-157380cc81a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:23Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdc603f-0794-4ee1-a6e7-7e05ed7ebe8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcdc603f-0794-4ee1-a6e7-7e05ed7ebe8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d65b4a-6ad6-4167-afbd-6c9fb3d91194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (06d65b4a-6ad6-4167-afbd-6c9fb3d91194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c1784a9f-3dce-4334-8beb-157380cc81a2', 'volume_name': 'volume-c1784a9f-3dce-4334-8beb-157380cc81a2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fd6364-dc7f-4bf5-98a4-41942de51eef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7fd6364-dc7f-4bf5-98a4-41942de51eef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71259da-8061-4339-801c-0c9f4a549e70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume c1784a9f-3dce-4334-8beb-157380cc81a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c1784a9f-3dce-4334-8beb-157380cc81a2', 'volume_size': 1} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (b376b454-b857-426a-9040-a1e03220e2b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb63593-37fb-4b26-920c-dea122331192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5bb63593-37fb-4b26-920c-dea122331192) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911522138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f137e2a-1512-42ac-a777-ad83f39a2767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:24Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9156b6-5165-41ff-9f8b-100228d9c1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c9156b6-5165-41ff-9f8b-100228d9c1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17d03fc-365c-43a6-97ba-1b374274aa39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f17d03fc-365c-43a6-97ba-1b374274aa39) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f137e2a-1512-42ac-a777-ad83f39a2767', 'volume_name': 'volume-4f137e2a-1512-42ac-a777-ad83f39a2767', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aadd62e-5716-42fd-a0db-3375b035e4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8aadd62e-5716-42fd-a0db-3375b035e4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0856a0-a2b2-4cd2-831b-2f79ff1bdfd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume 4f137e2a-1512-42ac-a777-ad83f39a2767: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f137e2a-1512-42ac-a777-ad83f39a2767', 'volume_size': 1} Jul 06 21:29:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:24 devstack sudo[106209]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] <== create_volume: return (1686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.689s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.320s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-801034074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbd92e6d-4870-409c-a5a3-1d33e3e77046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:23Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Creating volume dbd92e6d-4870-409c-a5a3-1d33e3e77046 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:29:24 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (651c3881-8496-47c0-b8af-34fb64ac4d4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-114510d8-9195-4850-a234-ba44ecbb91c3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:24 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 1073741824 Jul 06 21:29:24 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4a2562-628d-4344-8c91-f877c4f5f857) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:24 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume volume-114510d8-9195-4850-a234-ba44ecbb91c3 (114510d8-9195-4850-a234-ba44ecbb91c3): created successfully Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d4a2562-628d-4344-8c91-f877c4f5f857) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (f61f096d-5143-484f-882c-17956ceeb0d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8119e280-71c2-4901-b027-08970504ca4a tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created volume successfully. Jul 06 21:29:24 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 1073741824" returned: 0 in 0.819s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:24 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 Jul 06 21:29:24 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:25 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046" returned: 0 in 0.631s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] <== create_volume: return (1486ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.489s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.340s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1681645635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f14812f3-a46d-44ce-aab7-f6273c17d332,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:23Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Creating volume f14812f3-a46d-44ce-aab7-f6273c17d332 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:29:25 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:25 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 1073741824 Jul 06 21:29:25 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f33334ff-bf3a-4f11-97e1-3305cc3cd828) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffcf023-0810-4deb-9440-8dd0e550d301) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:25 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 (dbd92e6d-4870-409c-a5a3-1d33e3e77046): created successfully Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ffcf023-0810-4deb-9440-8dd0e550d301) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (ca753fec-56fe-4dca-8c0b-8e7d6de03cd9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-759d8827-d693-40ce-acb2-1449ae8db5cc tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created volume successfully. Jul 06 21:29:26 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 1073741824" returned: 0 in 0.798s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:26 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 Jul 06 21:29:26 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:27 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332" returned: 0 in 0.650s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] <== create_volume: return (1484ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.488s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.520s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-332650142',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c1784a9f-3dce-4334-8beb-157380cc81a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:23Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Creating volume c1784a9f-3dce-4334-8beb-157380cc81a2 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:29:27 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:27 devstack sudo[106229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 1073741824 Jul 06 21:29:27 devstack sudo[106229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac01b98d-db9e-43a7-a240-c793dddda59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f14812f3-a46d-44ce-aab7-f6273c17d332', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c61813-4eed-4003-88c8-5bd56c79308c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:27 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume volume-f14812f3-a46d-44ce-aab7-f6273c17d332 (f14812f3-a46d-44ce-aab7-f6273c17d332): created successfully Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70c61813-4eed-4003-88c8-5bd56c79308c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (81c522d6-1273-4463-b600-55d41041715d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d674e2c8-e2ec-4e75-8d87-bc9affdab853 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created volume successfully. Jul 06 21:29:27 devstack sudo[106229]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 1073741824" returned: 0 in 0.813s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:27 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 Jul 06 21:29:27 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:28 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2" returned: 0 in 0.640s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] <== create_volume: return (1487ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.490s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.641s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1911522138',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f137e2a-1512-42ac-a777-ad83f39a2767,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d2bae51cfbd942828adecef8e234eb28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:29:24Z,use_quota=True,user_id='a2a149ef3ec94eefb62e4619b7ebbb89',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Creating volume 4f137e2a-1512-42ac-a777-ad83f39a2767 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:29:28 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d71259da-8061-4339-801c-0c9f4a549e70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c1784a9f-3dce-4334-8beb-157380cc81a2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:28 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 1073741824 Jul 06 21:29:28 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f18345e-6d37-4350-b63b-09a27476f577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume volume-c1784a9f-3dce-4334-8beb-157380cc81a2 (c1784a9f-3dce-4334-8beb-157380cc81a2): created successfully Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f18345e-6d37-4350-b63b-09a27476f577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (68c8895e-66c2-4699-81ef-27c91048f816) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5f0d888b-7967-4318-abae-a2ef6605079d tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created volume successfully. Jul 06 21:29:29 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 1073741824" returned: 0 in 0.867s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:29 devstack sudo[106244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 Jul 06 21:29:29 devstack sudo[106244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:30 devstack sudo[106244]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767" returned: 0 in 0.652s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de0856a0-a2b2-4cd2-831b-2f79ff1bdfd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f137e2a-1512-42ac-a777-ad83f39a2767', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5afddf4-ff50-4945-87f6-965de1b5547a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:29:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Volume volume-4f137e2a-1512-42ac-a777-ad83f39a2767 (4f137e2a-1512-42ac-a777-ad83f39a2767): created successfully Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c5afddf4-ff50-4945-87f6-965de1b5547a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Flow 'volume_create_manager' (b376b454-b857-426a-9040-a1e03220e2b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:29:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c41bbd11-c0b8-4088-81be-af9321065fc4 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created volume successfully. Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-4f137e2a-1512-42ac-a777-ad83f39a2767-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-4f137e2a-1512-42ac-a777-ad83f39a2767-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-4f137e2a-1512-42ac-a777-ad83f39a2767" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-4f137e2a-1512-42ac-a777-ad83f39a2767" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d06b120-720c-4dcd-9cf9-3492b9cf377c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:30 devstack sudo[106247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 Jul 06 21:29:30 devstack sudo[106247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:31 devstack sudo[106247]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767" returned: 0 in 0.734s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:31 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767 Jul 06 21:29:31 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:31 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f137e2a-1512-42ac-a777-ad83f39a2767" returned: 0 in 0.639s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-4f137e2a-1512-42ac-a777-ad83f39a2767" released by "delete_volume" :: held 1.408s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created reservations ['649add61-6665-4c40-9941-8a3774b6b6f3', 'aa8dc520-4e38-4e1b-8fda-1b9160d1a566', '0f5310de-282a-476f-bc85-66aed4df594c', 'c6cdc242-c8f0-4fb9-af66-d01a990161d5'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:32 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:32 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:32 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.633s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-c1784a9f-3dce-4334-8beb-157380cc81a2-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Deleted volume successfully. Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-c1784a9f-3dce-4334-8beb-157380cc81a2-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7ff43a98-56b1-4676-83b3-3320c28690bb tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-4f137e2a-1512-42ac-a777-ad83f39a2767-delete_volume" released by "delete_volume" :: held 2.249s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-c1784a9f-3dce-4334-8beb-157380cc81a2" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-c1784a9f-3dce-4334-8beb-157380cc81a2" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d1f2ac2-7d75-4480-85a2-0ded4140885f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:32 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 Jul 06 21:29:32 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:33 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2" returned: 0 in 0.730s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:33 devstack sudo[106263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2 Jul 06 21:29:33 devstack sudo[106263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:34 devstack sudo[106263]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-c1784a9f-3dce-4334-8beb-157380cc81a2" returned: 0 in 0.631s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-c1784a9f-3dce-4334-8beb-157380cc81a2" released by "delete_volume" :: held 1.397s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created reservations ['c77a21b3-f5b7-40a0-ab03-50aa3011e4a4', '330562c7-8012-4c8e-972f-1296ff044590', 'ddc81992-49ed-41e1-ad35-67b0eed90034', '0a763b3e-1ad5-499e-8b95-7f8beb265dc7'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:34 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:34 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:34 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.641s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-f14812f3-a46d-44ce-aab7-f6273c17d332-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Deleted volume successfully. Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-f14812f3-a46d-44ce-aab7-f6273c17d332-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-05b8f486-aea6-4160-b9ad-8954abd4d3d7 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-c1784a9f-3dce-4334-8beb-157380cc81a2-delete_volume" released by "delete_volume" :: held 2.246s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-f14812f3-a46d-44ce-aab7-f6273c17d332" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-f14812f3-a46d-44ce-aab7-f6273c17d332" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[68f33d16-5bf2-4831-a8ca-0f115a0eab58]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:35 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 Jul 06 21:29:35 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:35 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332" returned: 0 in 0.742s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:35 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332 Jul 06 21:29:35 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:36 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-f14812f3-a46d-44ce-aab7-f6273c17d332" returned: 0 in 0.622s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-f14812f3-a46d-44ce-aab7-f6273c17d332" released by "delete_volume" :: held 1.407s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created reservations ['cdb75642-79fa-4f94-a8ab-f21341652936', '0e17bbdc-ece7-4744-83e5-588c33dd6070', '81118fc5-255d-4b0c-819f-6744150aeedc', 'fe294b2a-9f23-4576-af74-dc4669f23dfb'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:36 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:36 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:37 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.641s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-dbd92e6d-4870-409c-a5a3-1d33e3e77046-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:37 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Deleted volume successfully. Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-dbd92e6d-4870-409c-a5a3-1d33e3e77046-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc57f941-52a7-489e-aa70-25465b1a6dc1 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-f14812f3-a46d-44ce-aab7-f6273c17d332-delete_volume" released by "delete_volume" :: held 2.263s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-dbd92e6d-4870-409c-a5a3-1d33e3e77046" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-dbd92e6d-4870-409c-a5a3-1d33e3e77046" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc2791a7-a660-4e2c-8837-95084908cbad]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:37 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 Jul 06 21:29:37 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:37 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046" returned: 0 in 0.743s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:37 devstack sudo[106285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046 Jul 06 21:29:37 devstack sudo[106285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:38 devstack sudo[106285]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dbd92e6d-4870-409c-a5a3-1d33e3e77046" returned: 0 in 0.634s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-dbd92e6d-4870-409c-a5a3-1d33e3e77046" released by "delete_volume" :: held 1.413s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created reservations ['960334c0-f7bc-4f26-bd0d-47e804c00541', 'f9e1a190-2dc3-45b8-8fb2-cf4d3d14f658', '199cab80-be6c-4045-ae54-63d686ed8e83', 'ac2f915c-d5ee-4581-9150-9dd898b461d8'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:38 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:38 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:39 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-114510d8-9195-4850-a234-ba44ecbb91c3-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.641s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Deleted volume successfully. Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-114510d8-9195-4850-a234-ba44ecbb91c3-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db0ef19-ee37-4c0f-ba45-3d5f44b021f0 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-dbd92e6d-4870-409c-a5a3-1d33e3e77046-delete_volume" released by "delete_volume" :: held 2.259s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-114510d8-9195-4850-a234-ba44ecbb91c3" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-114510d8-9195-4850-a234-ba44ecbb91c3" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a429cd1a-53da-4515-82e2-1530bd3fee39]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:39 devstack sudo[106292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 Jul 06 21:29:39 devstack sudo[106292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:40 devstack sudo[106292]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3" returned: 0 in 0.771s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:40 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3 Jul 06 21:29:40 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:40 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-114510d8-9195-4850-a234-ba44ecbb91c3" returned: 0 in 0.643s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-114510d8-9195-4850-a234-ba44ecbb91c3" released by "delete_volume" :: held 1.454s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created reservations ['adc8b561-bd89-4ed2-8e64-b580db13b515', '6362774f-5f7e-48c8-b025-32cd60bda950', '93befd85-e483-4bc4-89e5-80733ee25036', 'da861505-6611-4773-9e83-8ec5bbf88283'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:41 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:41 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-7bc269ea-babf-422e-ba7f-4a062e86adfb-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-7bc269ea-babf-422e-ba7f-4a062e86adfb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-7bc269ea-babf-422e-ba7f-4a062e86adfb" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-7bc269ea-babf-422e-ba7f-4a062e86adfb" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Deleting offline snapshot 7bc269ea-babf-422e-ba7f-4a062e86adfb of volume 6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] snapshot_file for this snap is: volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[69ccc787-6475-4773-abfd-81de07fcf8a2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:41 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Deleted volume successfully. Jul 06 21:29:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f0028ee8-5915-447b-bd75-c2d8adbf566c tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-114510d8-9195-4850-a234-ba44ecbb91c3-delete_volume" released by "delete_volume" :: held 2.313s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:41 devstack sudo[106303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb Jul 06 21:29:41 devstack sudo[106303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:42 devstack sudo[106303]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb" returned: 0 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:29:42 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dcc49a5-19ba-4e3d-8039-9a09bcb48af5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:42 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 Jul 06 21:29:42 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:43 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" returned: 0 in 0.732s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:43 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb Jul 06 21:29:43 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:43 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb" returned: 0 in 0.734s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:43 devstack sudo[106318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb Jul 06 21:29:43 devstack sudo[106318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:44 devstack sudo[106318]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0.7bc269ea-babf-422e-ba7f-4a062e86adfb" returned: 0 in 0.636s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-7bc269ea-babf-422e-ba7f-4a062e86adfb" released by "_delete_snapshot" :: held 2.939s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" released by "delete_snapshot" :: held 2.961s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created reservations ['48aca91f-e454-4c1d-b000-f78d30da51ec', 'c0289cde-7a06-4619-a0ea-8f0c0fc7d2ff', 'bb4eaaab-0d3c-4f95-861d-b35626c6338a', '2ffe2def-591a-40bf-9593-857c3a150daf'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Delete snapshot completed successfully. Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6dd5184d-47ad-43d9-90e4-8542b788a64e tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-7bc269ea-babf-422e-ba7f-4a062e86adfb-delete_snapshot" released by "delete_snapshot" :: held 3.083s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "cinder-quobyte-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[04d76e4d-f61d-459f-8d55-bdf9aa8c333e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:29:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:44 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 Jul 06 21:29:44 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:45 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" returned: 0 in 0.733s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:45 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0 Jul 06 21:29:45 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:46 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" returned: 0 in 0.623s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-quobyte-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0" released by "delete_volume" :: held 1.409s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Created reservations ['92112e84-f888-4f08-99e1-af528412c823', 'dc9dbf25-2823-4132-a689-fb633d2e5c52', 'a963f56b-5793-46e4-8dd0-e74ef0a6c440', '686297b5-e304-499b-b568-96fa18fd3918'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:29:46 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:29:46 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:29:46 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.626s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:29:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Deleted volume successfully. Jul 06 21:29:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cf16ad97-a4b1-4b2f-bd91-ebfeaa9d1718 tempest-CreateVolumesFromSnapshotTest-1121623865 None] Lock "cinder-6fe3b6c2-d4d2-47b5-a52b-e01b05f88fb0-delete_volume" released by "delete_volume" :: held 2.219s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:29:56 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=93,cinder:SELECT=54,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:29:56 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=75,cinder:INSERT=24,cinder:UPDATE=79,cinder:DELETE=6 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:01 devstack sudo[106417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:01 devstack sudo[106417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:01 devstack sudo[106417]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.784s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:30:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:30:02 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (715444be-2b14-45b9-96ec-2ec8f844e71c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c651a409-acd4-4f2c-b828-87a6f1644a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c651a409-acd4-4f2c-b828-87a6f1644a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-44619583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd5887b-5890-4a2c-91a8-be7aa4e83ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:03Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dad2476-9709-4109-b4ee-38ba3b683823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dad2476-9709-4109-b4ee-38ba3b683823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bf7db2-49cf-4ff1-9643-60afea86a161) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13bf7db2-49cf-4ff1-9643-60afea86a161) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6cd5887b-5890-4a2c-91a8-be7aa4e83ccd', 'volume_name': 'volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318f03be-c4df-4d52-ab25-f177189afee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (318f03be-c4df-4d52-ab25-f177189afee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c808f1-a5b3-4e12-b540-1d9ab9ebb089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Volume 6cd5887b-5890-4a2c-91a8-be7aa4e83ccd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd', 'volume_size': 1} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-44619583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6cd5887b-5890-4a2c-91a8-be7aa4e83ccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:03Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Creating volume 6cd5887b-5890-4a2c-91a8-be7aa4e83ccd {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:03 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:03 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd 1073741824 Jul 06 21:30:03 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (8ad5807e-0bc9-403c-95f1-b89e2d5462ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12c2797-99d9-488a-8253-7215cb0c1a64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12c2797-99d9-488a-8253-7215cb0c1a64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1715318955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56097d7f-e94a-4bc4-8786-ffd3d9184dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:03Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23de626d-bf7c-48b7-8458-58cc48f61705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23de626d-bf7c-48b7-8458-58cc48f61705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78244ddd-4d42-45b7-985b-3759d7692721) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78244ddd-4d42-45b7-985b-3759d7692721) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56097d7f-e94a-4bc4-8786-ffd3d9184dc2', 'volume_name': 'volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd71967f-59f5-467a-a4d7-020c120a7e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd71967f-59f5-467a-a4d7-020c120a7e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971aa0aa-52b5-4081-891d-c6f067fcc901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume 56097d7f-e94a-4bc4-8786-ffd3d9184dc2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2', 'volume_size': 1} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (29aeea4a-d96d-4c60-887e-db97abee8a6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5560e3-b6fb-4b9b-a688-a4db522a9eca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e5560e3-b6fb-4b9b-a688-a4db522a9eca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286425729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7141ab-45dd-4577-84d7-0af535fe93d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519b38b8-191f-49cd-851b-cab96a5bc62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519b38b8-191f-49cd-851b-cab96a5bc62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffe6fea-dc05-410f-9f01-04eaeaafb2fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffe6fea-dc05-410f-9f01-04eaeaafb2fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a7141ab-45dd-4577-84d7-0af535fe93d3', 'volume_name': 'volume-2a7141ab-45dd-4577-84d7-0af535fe93d3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84eef392-5b37-48a3-8270-8193121e5d65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (84eef392-5b37-48a3-8270-8193121e5d65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b80f81-7f38-41d7-9678-d39d3408eda2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Volume 2a7141ab-45dd-4577-84d7-0af535fe93d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a7141ab-45dd-4577-84d7-0af535fe93d3', 'volume_size': 1} Jul 06 21:30:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (9979fb3f-e11e-4e45-ba28-d55e8bc55ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47031e3-d9ca-49a7-aaf1-5bf8091e0656) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (3e975388-c1a1-4a4f-9b63-0edc2e5bac1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a60fdd-56e6-4bfe-bd02-2e59d6bbfa7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69a60fdd-56e6-4bfe-bd02-2e59d6bbfa7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416060593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0103aa-a70d-4919-8ef3-e15bd29ba4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ac506b-d2f8-409d-962b-d34e31c6783f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0ac506b-d2f8-409d-962b-d34e31c6783f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c07fa6-a5a9-494e-8acb-01253cc73ff7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18c07fa6-a5a9-494e-8acb-01253cc73ff7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6e0103aa-a70d-4919-8ef3-e15bd29ba4e6', 'volume_name': 'volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2036b25a-b583-44c3-9a0b-4a22b3c62b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2036b25a-b583-44c3-9a0b-4a22b3c62b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1ad73a-76b2-41ae-b84d-a6be7ca85cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume 6e0103aa-a70d-4919-8ef3-e15bd29ba4e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6', 'volume_size': 1} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:04 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f47031e3-d9ca-49a7-aaf1-5bf8091e0656) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527834239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f661a67-49e7-4c42-a867-675e983954d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f0ce8-24f7-4636-a09f-576009937d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1f0ce8-24f7-4636-a09f-576009937d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378ccc4f-b526-4a0f-87e9-eb7ca25a60fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (378ccc4f-b526-4a0f-87e9-eb7ca25a60fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1f661a67-49e7-4c42-a867-675e983954d0', 'volume_name': 'volume-1f661a67-49e7-4c42-a867-675e983954d0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b8daca-198c-4f66-b776-0e975962d67a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b8daca-198c-4f66-b776-0e975962d67a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822268ea-de55-410d-b039-308b3c462375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Volume 1f661a67-49e7-4c42-a867-675e983954d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1f661a67-49e7-4c42-a867-675e983954d0', 'volume_size': 1} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd 1073741824" returned: 0 in 1.408s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (5a0b9c8a-f7cb-4dd3-b13f-47a090a5f1d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a504c66-bce6-44f1-9f9d-f7fe0edfaf0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a504c66-bce6-44f1-9f9d-f7fe0edfaf0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592117446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9940a715-5cd4-4113-8264-e924ba59f6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1deef0-b8cb-4e7c-912f-5dcba2e0ad2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1deef0-b8cb-4e7c-912f-5dcba2e0ad2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36251f-1f29-4f9f-9d62-23221b8c93a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f36251f-1f29-4f9f-9d62-23221b8c93a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9940a715-5cd4-4113-8264-e924ba59f6b8', 'volume_name': 'volume-9940a715-5cd4-4113-8264-e924ba59f6b8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc35757-0882-42a0-8123-210b8f724788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adc35757-0882-42a0-8123-210b8f724788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498eb6c4-875e-4baa-9b48-adb4ee96f2c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Volume 9940a715-5cd4-4113-8264-e924ba59f6b8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9940a715-5cd4-4113-8264-e924ba59f6b8', 'volume_size': 1} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:04 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd Jul 06 21:30:04 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (bc658e9f-0b28-4911-86f1-af40d4dca8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb5b758-4e38-4a72-a477-907aa587cc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1eb5b758-4e38-4a72-a477-907aa587cc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-727328785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253ac945-5b81-4b6f-a8e8-1a0ec99ccf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:05Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a11fac-39de-47fe-b31c-a40f07a5fc87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68a11fac-39de-47fe-b31c-a40f07a5fc87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a12bfe1-99a8-4953-94c6-00435199d587) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3a12bfe1-99a8-4953-94c6-00435199d587) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '253ac945-5b81-4b6f-a8e8-1a0ec99ccf04', 'volume_name': 'volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5693a798-65fe-4672-bc0b-6b3880e383e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5693a798-65fe-4672-bc0b-6b3880e383e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ad25d-4970-4e7e-9054-9af95035ebcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Volume 253ac945-5b81-4b6f-a8e8-1a0ec99ccf04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04', 'volume_size': 1} Jul 06 21:30:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:05 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd" returned: 0 in 0.715s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] <== create_volume: return (2250ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.255s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.755s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1715318955',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56097d7f-e94a-4bc4-8786-ffd3d9184dc2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:03Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Creating volume 56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:05 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (76c808f1-a5b3-4e12-b540-1d9ab9ebb089) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163e55b-cae2-496c-a564-fa4c4fd6cecb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:05 devstack sudo[106432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 1073741824 Jul 06 21:30:05 devstack sudo[106432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:05 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Volume volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd (6cd5887b-5890-4a2c-91a8-be7aa4e83ccd): created successfully Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1163e55b-cae2-496c-a564-fa4c4fd6cecb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (715444be-2b14-45b9-96ec-2ec8f844e71c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6f3ef3f5-569c-4e93-b826-80b052750983 tempest-CreateVolumesFromImageTest-1902992813 None] Created volume successfully. Jul 06 21:30:06 devstack sudo[106432]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 1073741824" returned: 0 in 0.861s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:06 devstack sudo[106438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 Jul 06 21:30:06 devstack sudo[106438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:06 devstack sudo[106438]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" returned: 0 in 0.710s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] <== create_volume: return (1614ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.618s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.137s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1286425729',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a7141ab-45dd-4577-84d7-0af535fe93d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Creating volume 2a7141ab-45dd-4577-84d7-0af535fe93d3 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:07 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:07 devstack sudo[106441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 1073741824 Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (971aa0aa-52b5-4081-891d-c6f067fcc901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:07 devstack sudo[106441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba9cd60-ad2e-4441-8819-e01258b676b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 (56097d7f-e94a-4bc4-8786-ffd3d9184dc2): created successfully Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba9cd60-ad2e-4441-8819-e01258b676b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (8ad5807e-0bc9-403c-95f1-b89e2d5462ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-29e6dce2-a46d-42a2-ad75-306ee877ece5 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created volume successfully. Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Flow 'volume_create_manager' (7418acc0-9a09-4c41-87ac-0c67af55d653) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6329afea-8270-4ba7-986a-4dc0cae0c5ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6329afea-8270-4ba7-986a-4dc0cae0c5ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863bb7e9-9f08-4aaf-b499-00cc08061f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35068601065d4246a9bed75df7b08596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:07Z,use_quota=True,user_id='430ba398ebbc478c8b6a31bbf9311b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c1f87f3-59dc-4291-adb8-bd8b73968892),volume_type_id=5c1f87f3-59dc-4291-adb8-bd8b73968892)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4126f9-d3ea-4b4c-b33e-4319e74142ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4126f9-d3ea-4b4c-b33e-4319e74142ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61b1655-dc68-4a1d-ac32-9eacdcd28874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b61b1655-dc68-4a1d-ac32-9eacdcd28874) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '863bb7e9-9f08-4aaf-b499-00cc08061f03', 'volume_name': 'volume-863bb7e9-9f08-4aaf-b499-00cc08061f03', 'volume_size': 1, 'image_id': '743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfdd00a26d90e350e05e73e918d32b6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35068601065d4246a9bed75df7b08596', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c7fe329b47a198dbaa0a1abdfa958df721c0da872140304f3a1991fde7aa8989ea0a3ea244a6f982c39508d42eab75ec94efd33fb5953626fbe4e94441c61e60', 'id': '743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'created_at': datetime.datetime(2026, 7, 6, 19, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2f9629-df5e-471a-bd6a-3c868c8ca4d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d2f9629-df5e-471a-bd6a-3c868c8ca4d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2b7413-57b3-4333-835a-1395938df535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Volume 863bb7e9-9f08-4aaf-b499-00cc08061f03: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-863bb7e9-9f08-4aaf-b499-00cc08061f03', 'volume_size': 1, 'image_id': '743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfdd00a26d90e350e05e73e918d32b6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35068601065d4246a9bed75df7b08596', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c7fe329b47a198dbaa0a1abdfa958df721c0da872140304f3a1991fde7aa8989ea0a3ea244a6f982c39508d42eab75ec94efd33fb5953626fbe4e94441c61e60', 'id': '743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'created_at': datetime.datetime(2026, 7, 6, 19, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Trying to clone 863bb7e9-9f08-4aaf-b499-00cc08061f03 from image 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 at location (None, [{'url': 'file:///opt/stack/data/glance/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:30:07 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Image download 0.00 MB at 0.00 MB/s Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0af78a3c-0586-46dd-a553-b646d11414e8]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:07 devstack sudo[106446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD Jul 06 21:30:07 devstack sudo[106446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:07 devstack sudo[106441]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 1073741824" returned: 0 in 0.904s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:07 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 Jul 06 21:30:07 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:08 devstack sudo[106446]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD" returned: 0 in 0.774s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:08 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD Jul 06 21:30:08 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:08 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] <== create_volume: return (1599ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.603s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.118s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-416060593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6e0103aa-a70d-4919-8ef3-e15bd29ba4e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Creating volume 6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:08 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:08 devstack sudo[106456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 1073741824 Jul 06 21:30:08 devstack sudo[106456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5b80f81-7f38-41d7-9678-d39d3408eda2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a7141ab-45dd-4577-84d7-0af535fe93d3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4374b3ef-5861-4c43-8eaf-39cfd1713482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:08 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Volume volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 (2a7141ab-45dd-4577-84d7-0af535fe93d3): created successfully Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4374b3ef-5861-4c43-8eaf-39cfd1713482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (29aeea4a-d96d-4c60-887e-db97abee8a6a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-9fe334aa-8b2a-4626-a028-da6141361ba6 tempest-CreateVolumesFromImageTest-1902992813 None] Created volume successfully. Jul 06 21:30:09 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD" returned: 1 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:09 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Temporary image 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 is fetched for user 430ba398ebbc478c8b6a31bbf9311b71. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:30:09 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[176c1c1a-8f2a-4226-9bdf-79d1cf7c83e9]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:09 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD Jul 06 21:30:09 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:09 devstack sudo[106456]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 1073741824" returned: 0 in 0.938s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:09 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 Jul 06 21:30:09 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:10 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD" returned: 0 in 0.749s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:10 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD Jul 06 21:30:10 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:10 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6" returned: 0 in 0.642s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] <== create_volume: return (1622ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.626s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.697s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-527834239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1f661a67-49e7-4c42-a867-675e983954d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Creating volume 1f661a67-49e7-4c42-a867-675e983954d0 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:10 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba1ad73a-76b2-41ae-b84d-a6be7ca85cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:10 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 1073741824 Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b123f93-a392-4b34-aab0-0cce46b25d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:10 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:10 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 (6e0103aa-a70d-4919-8ef3-e15bd29ba4e6): created successfully Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b123f93-a392-4b34-aab0-0cce46b25d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (3e975388-c1a1-4a4f-9b63-0edc2e5bac1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:10 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f7f1d2e9-74ef-4f0d-be97-54986575064e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created volume successfully. Jul 06 21:30:10 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD" returned: 1 in 0.757s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:11 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 1073741824" returned: 0 in 0.806s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:11 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 Jul 06 21:30:11 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:11 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0" returned: 0 in 0.682s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] <== create_volume: return (1527ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.532s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.127s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-592117446',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9940a715-5cd4-4113-8264-e924ba59f6b8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:04Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Creating volume 9940a715-5cd4-4113-8264-e924ba59f6b8 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:11 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:11 devstack sudo[106486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 1073741824 Jul 06 21:30:11 devstack sudo[106486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (822268ea-de55-410d-b039-308b3c462375) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1f661a67-49e7-4c42-a867-675e983954d0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aecaedd-bf55-4bf3-a9a5-f1abc9e451af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:11 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Volume volume-1f661a67-49e7-4c42-a867-675e983954d0 (1f661a67-49e7-4c42-a867-675e983954d0): created successfully Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aecaedd-bf55-4bf3-a9a5-f1abc9e451af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (9979fb3f-e11e-4e45-ba28-d55e8bc55ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (d46e4897-b467-4257-9318-8998ca74b8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c49f82-6b71-490f-b9fe-d700d0bd59a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:11 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-22fa01ea-17cf-4e64-b1ef-9d1e3164e4a8 tempest-CreateVolumesFromImageTest-1902992813 None] Created volume successfully. Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2c49f82-6b71-490f-b9fe-d700d0bd59a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317589495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e987d5bc-3c69-47a8-8165-50aaf699630f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:12Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2565863-8d81-4f33-bd1f-8259e8e1c1ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2565863-8d81-4f33-bd1f-8259e8e1c1ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bdbcaf-e340-448d-9307-3984ad127ec2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79bdbcaf-e340-448d-9307-3984ad127ec2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e987d5bc-3c69-47a8-8165-50aaf699630f', 'volume_name': 'volume-e987d5bc-3c69-47a8-8165-50aaf699630f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef313119-77ad-40a8-a184-82a5f083b8fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ef313119-77ad-40a8-a184-82a5f083b8fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8513dd3b-ff5e-42ff-a396-ae3d4d3b49a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:11 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume e987d5bc-3c69-47a8-8165-50aaf699630f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e987d5bc-3c69-47a8-8165-50aaf699630f', 'volume_size': 1} Jul 06 21:30:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (6d472578-e334-4c55-9057-6e7dffc479ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d95578-e216-47f8-b1a0-f36da63c5973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93d95578-e216-47f8-b1a0-f36da63c5973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172311442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d68de62-3dea-4d1b-90cf-32d88618eb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:12Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b1a825-9c78-416a-b9f4-315de4134f87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46b1a825-9c78-416a-b9f4-315de4134f87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf1558b-3b57-49aa-8b67-bf2efd01ed0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bf1558b-3b57-49aa-8b67-bf2efd01ed0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d68de62-3dea-4d1b-90cf-32d88618eb9b', 'volume_name': 'volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0433aa4-db98-4aed-bfb8-2e0458707426) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0433aa4-db98-4aed-bfb8-2e0458707426) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33b1da7-0d77-4095-8863-4653c80592dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume 2d68de62-3dea-4d1b-90cf-32d88618eb9b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b', 'volume_size': 1} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (7602ff7d-9085-41cd-af4d-dd43386392fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9df99f-51b4-418e-8550-98c2607cb363) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab9df99f-51b4-418e-8550-98c2607cb363) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366171907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25627720-f808-43bb-ba48-3578fc0ce09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:13Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa1436e-a066-449f-b0ba-f9601fc9309e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caa1436e-a066-449f-b0ba-f9601fc9309e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cd6551-e9a1-4d0c-a053-6c31eb0d2baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (25cd6551-e9a1-4d0c-a053-6c31eb0d2baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25627720-f808-43bb-ba48-3578fc0ce09a', 'volume_name': 'volume-25627720-f808-43bb-ba48-3578fc0ce09a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19720f0-c8c8-451f-886e-8fb5c1bda413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b19720f0-c8c8-451f-886e-8fb5c1bda413) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c015451-faee-4813-839d-c52e479d1fa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume 25627720-f808-43bb-ba48-3578fc0ce09a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25627720-f808-43bb-ba48-3578fc0ce09a', 'volume_size': 1} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:12 devstack sudo[106486]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 1073741824" returned: 0 in 0.985s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:12 devstack sudo[106492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 Jul 06 21:30:12 devstack sudo[106492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (0b40cb2e-de0b-4ed0-b25d-fc88197dd2be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a399354f-8821-43ff-b07c-dfb01da637c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a399354f-8821-43ff-b07c-dfb01da637c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128444891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3bfae5-012d-4ca3-a90d-d06cee559113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:13Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33b717d-4a76-42e0-b672-03f5959ca9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e33b717d-4a76-42e0-b672-03f5959ca9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d91d124-86b7-482b-89f2-33d373dc083b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d91d124-86b7-482b-89f2-33d373dc083b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5f3bfae5-012d-4ca3-a90d-d06cee559113', 'volume_name': 'volume-5f3bfae5-012d-4ca3-a90d-d06cee559113', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329fc26e-f5fa-4766-8205-9c8a83ca9d16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (329fc26e-f5fa-4766-8205-9c8a83ca9d16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5993b8ec-66c5-4f89-abc3-e15b20b3c53f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume 5f3bfae5-012d-4ca3-a90d-d06cee559113: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5f3bfae5-012d-4ca3-a90d-d06cee559113', 'volume_size': 1} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (072d926d-bbcb-4166-8aff-e42ebdb68f88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9cb666-c388-4ad4-a6c8-2340caa67267) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d9cb666-c388-4ad4-a6c8-2340caa67267) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302596535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3505ea-4cec-4293-bc59-3fd394d03233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:13Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed3c3c3-5232-4477-bc53-ec69b238d4e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1ed3c3c3-5232-4477-bc53-ec69b238d4e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7442db-6635-4d44-b19d-4154eaa04839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba7442db-6635-4d44-b19d-4154eaa04839) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6b3505ea-4cec-4293-bc59-3fd394d03233', 'volume_name': 'volume-6b3505ea-4cec-4293-bc59-3fd394d03233', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa559c2-f42f-4bbe-81c1-7c60f2b0efaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5fa559c2-f42f-4bbe-81c1-7c60f2b0efaa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e7155-454b-46f0-9821-427e08e95899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume 6b3505ea-4cec-4293-bc59-3fd394d03233: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6b3505ea-4cec-4293-bc59-3fd394d03233', 'volume_size': 1} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:13 devstack sudo[106492]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] <== create_volume: return (1725ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.729s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.588s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-727328785',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=253ac945-5b81-4b6f-a8e8-1a0ec99ccf04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3bd506eeea0e46839c7368f17a40360c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:05Z,use_quota=True,user_id='a5b3ccdb041a452c82fefdf1d7ccde92',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Creating volume 253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:13 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (498eb6c4-875e-4baa-9b48-adb4ee96f2c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9940a715-5cd4-4113-8264-e924ba59f6b8', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 1073741824 Jul 06 21:30:13 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48a21a9-d9fe-4204-a263-edbbe1053bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Volume volume-9940a715-5cd4-4113-8264-e924ba59f6b8 (9940a715-5cd4-4113-8264-e924ba59f6b8): created successfully Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48a21a9-d9fe-4204-a263-edbbe1053bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (5a0b9c8a-f7cb-4dd3-b13f-47a090a5f1d0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-9a84c1a9-4690-47a1-8aaf-9827b9fdfa28 tempest-CreateVolumesFromImageTest-1902992813 None] Created volume successfully. Jul 06 21:30:14 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 1073741824" returned: 0 in 0.824s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:14 devstack sudo[106501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 Jul 06 21:30:14 devstack sudo[106501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:14 devstack sudo[106501]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04" returned: 0 in 0.630s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.493s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.229s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (308ad25d-4970-4e7e-9054-9af95035ebcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70aa786-cd2a-4d44-b699-733053baf18f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Creating offline snapshot 202be8d5-eb34-4784-b44b-c807ba7afaeb of volume 56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:30:15 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Volume volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 (253ac945-5b81-4b6f-a8e8-1a0ec99ccf04): created successfully Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e70aa786-cd2a-4d44-b699-733053baf18f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Flow 'volume_create_manager' (bc658e9f-0b28-4911-86f1-af40d4dca8b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c61eeadf-fc3c-454d-8e47-fc3c7645d022]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:15 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-69f9b2d4-c989-4299-a218-faa184163296 tempest-CreateVolumesFromImageTest-1902992813 None] Created volume successfully. Jul 06 21:30:15 devstack sudo[106504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 Jul 06 21:30:15 devstack sudo[106504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:15 devstack sudo[106504]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" returned: 0 in 0.750s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:15 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb 1G Jul 06 21:30:15 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-quobyte-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e16e3d2f-7f57-45d2-9b21-c8bf5439df3f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:16 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 Jul 06 21:30:16 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:16 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb 1G" returned: 0 in 0.811s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:16 devstack sudo[106520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb Jul 06 21:30:16 devstack sudo[106520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:16 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04" returned: 0 in 0.798s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:16 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04 Jul 06 21:30:16 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:17 devstack sudo[106520]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb" returned: 0 in 0.699s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:17 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb is being set with open permissions: ugo+rw Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:17 devstack sudo[106528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb Jul 06 21:30:17 devstack sudo[106528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:17 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04" released by "delete_volume" :: held 1.508s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Created reservations ['1e332b66-073b-4861-bce7-b738b5bbbedc', 'b21e19fb-ffd1-4ad6-8312-3d593287475e', '57a211f3-0c1a-4b74-9d57-bf3b1b8b6743', '6409e416-3896-447d-b370-1db4572f497f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:17 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:17 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:17 devstack sudo[106528]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb" returned: 0 in 0.673s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:18 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.info Jul 06 21:30:18 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-9940a715-5cd4-4113-8264-e924ba59f6b8-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-9940a715-5cd4-4113-8264-e924ba59f6b8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-quobyte-9940a715-5cd4-4113-8264-e924ba59f6b8" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-9940a715-5cd4-4113-8264-e924ba59f6b8" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bad4076d-3aaf-4430-a152-c05bc754b68d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:18 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.702s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:18 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Deleted volume successfully. Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-94d08535-4125-4563-ac48-1a5b030cd087 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-253ac945-5b81-4b6f-a8e8-1a0ec99ccf04-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:18 devstack sudo[106536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 Jul 06 21:30:18 devstack sudo[106536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:18 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.info" returned: 0 in 0.684s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:18 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.info is being set with open permissions: ugo+rw Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:18 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.info Jul 06 21:30:18 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:18 devstack sudo[106536]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8" returned: 0 in 0.782s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:19 devstack sudo[106545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8 Jul 06 21:30:19 devstack sudo[106545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:19 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.info" returned: 0 in 0.664s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.414s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.646s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=863bb7e9-9f08-4aaf-b499-00cc08061f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35068601065d4246a9bed75df7b08596',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:07Z,use_quota=True,user_id='430ba398ebbc478c8b6a31bbf9311b71',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5c1f87f3-59dc-4291-adb8-bd8b73968892),volume_type_id=5c1f87f3-59dc-4291-adb8-bd8b73968892)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Creating volume 863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:19 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:19 devstack sudo[106548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 1073741824 Jul 06 21:30:19 devstack sudo[106548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7d640ccc-7db9-4e6a-9af4-16a0fd17f1e1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Create snapshot completed successfully Jul 06 21:30:19 devstack sudo[106545]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9940a715-5cd4-4113-8264-e924ba59f6b8" returned: 0 in 0.646s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-9940a715-5cd4-4113-8264-e924ba59f6b8" released by "delete_volume" :: held 1.469s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Created reservations ['b214fae7-dfad-4506-ab8a-8a231c184ecb', '670315c2-bebf-450c-9def-5cd21c663d8c', '5395ffbb-9141-495e-a6ac-fff7e1461858', 'e84ddc5c-a7d0-4d2b-98b7-173d6c186569'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:19 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:19 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:20 devstack sudo[106548]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 1073741824" returned: 0 in 0.888s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-1f661a67-49e7-4c42-a867-675e983954d0-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-1f661a67-49e7-4c42-a867-675e983954d0-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:20 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 Jul 06 21:30:20 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-quobyte-1f661a67-49e7-4c42-a867-675e983954d0" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-1f661a67-49e7-4c42-a867-675e983954d0" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7ba085a-8b4a-4a73-8ee1-962518939124]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:20 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.772s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Deleted volume successfully. Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-c99607d2-dc26-4070-82d9-b59afbb5f28e tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-9940a715-5cd4-4113-8264-e924ba59f6b8-delete_volume" released by "delete_volume" :: held 2.473s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:20 devstack sudo[106562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 Jul 06 21:30:20 devstack sudo[106562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (5788c174-fbaa-4855-afc5-617d37e13865) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f40d96-74f3-4174-a96d-ea2fb124617c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86f40d96-74f3-4174-a96d-ea2fb124617c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292351143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aef0c6d-c98c-46b3-b365-7b098d6430b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:21Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3e5e7a-c958-4065-8590-882375c587d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d3e5e7a-c958-4065-8590-882375c587d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e60fe14-5c60-42bc-8d76-05f943748e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e60fe14-5c60-42bc-8d76-05f943748e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4aef0c6d-c98c-46b3-b365-7b098d6430b4', 'volume_name': 'volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7579afb-097d-4adb-a6e8-8e203b07dfd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7579afb-097d-4adb-a6e8-8e203b07dfd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdde0b4-165a-40dc-b144-f5326cda4dbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume 4aef0c6d-c98c-46b3-b365-7b098d6430b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4', 'volume_size': 1} Jul 06 21:30:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (6338ce6d-4a27-4732-89f0-7c43ca0fb3fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f917ec-ed97-4c16-9d58-8c6b349c984c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03" returned: 0 in 0.880s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] <== create_volume: return (1851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.854s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.300s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1317589495',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e987d5bc-3c69-47a8-8165-50aaf699630f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:12Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Creating volume e987d5bc-3c69-47a8-8165-50aaf699630f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:21 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f917ec-ed97-4c16-9d58-8c6b349c984c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1883760423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16a41c-273d-4e1e-8abc-035db8e5dbc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:21Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1230bea7-6eba-4202-98e3-dbb22d303bce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1230bea7-6eba-4202-98e3-dbb22d303bce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f 1073741824 Jul 06 21:30:21 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727d51ec-e790-4a41-b467-f69715d5e236) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (727d51ec-e790-4a41-b467-f69715d5e236) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f16a41c-273d-4e1e-8abc-035db8e5dbc3', 'volume_name': 'volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c354758-ae5e-49c9-8973-e7c0b974e0e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c354758-ae5e-49c9-8973-e7c0b974e0e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3d9333-6350-43ad-8330-413bac82d1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume 0f16a41c-273d-4e1e-8abc-035db8e5dbc3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3', 'volume_size': 1} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Attempting download of 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'metadata': {}}])) to volume 863bb7e9-9f08-4aaf-b499-00cc08061f03. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6187028-1f85-4213-8de2-9a9080373888]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_mnc4pizx {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:21 devstack sudo[106562]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0" returned: 0 in 1.001s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:21 devstack sudo[106571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0 Jul 06 21:30:21 devstack sudo[106571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:21 devstack sudo[106570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_mnc4pizx Jul 06 21:30:21 devstack sudo[106570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (2ac0afe6-93cc-4ff8-aba0-ff2d7cafec67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a1dc3e-4c35-4f46-a22c-489ca111e0d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74a1dc3e-4c35-4f46-a22c-489ca111e0d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094110522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95a5600-b97a-4744-a421-28310dcf7f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:22Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb7d543-0dd6-443c-9621-4c3505f297e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ffb7d543-0dd6-443c-9621-4c3505f297e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6585467-1ada-4f7d-9c0e-879ca2a3df8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f6585467-1ada-4f7d-9c0e-879ca2a3df8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd95a5600-b97a-4744-a421-28310dcf7f03', 'volume_name': 'volume-d95a5600-b97a-4744-a421-28310dcf7f03', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365f468a-2593-45f5-bf58-f699897d904e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (365f468a-2593-45f5-bf58-f699897d904e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980c3cb9-1b33-428d-a397-aab97ead779d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:21 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume d95a5600-b97a-4744-a421-28310dcf7f03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d95a5600-b97a-4744-a421-28310dcf7f03', 'volume_size': 1} Jul 06 21:30:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (2df34e01-e877-48c3-8b86-8564812206a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d785eb-8b3d-41fe-ba89-d8732c58bfe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83d785eb-8b3d-41fe-ba89-d8732c58bfe6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-618019589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:22Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5eacb1-c0bc-400c-af0f-28aaa54db7e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c5eacb1-c0bc-400c-af0f-28aaa54db7e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42623abd-2d4e-4071-a8d7-7d52982be31e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42623abd-2d4e-4071-a8d7-7d52982be31e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae', 'volume_name': 'volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3d1d0a-5724-43d1-8a7d-e13687757321) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd3d1d0a-5724-43d1-8a7d-e13687757321) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02ebb29-68c8-4f11-b143-65e65175ca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae', 'volume_size': 1} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:22 devstack sudo[106570]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_mnc4pizx" returned: 0 in 0.957s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_mnc4pizx {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:22 devstack sudo[106571]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-1f661a67-49e7-4c42-a867-675e983954d0" returned: 0 in 1.028s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-1f661a67-49e7-4c42-a867-675e983954d0" released by "delete_volume" :: held 2.101s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:22 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:22 devstack sudo[106581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_mnc4pizx Jul 06 21:30:22 devstack sudo[106581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f 1073741824" returned: 0 in 1.337s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (93ae456d-2585-4921-8971-cd357065c225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ece8216-fd5d-45c4-bc59-db4a96903cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ece8216-fd5d-45c4-bc59-db4a96903cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692481825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcaa17e-589f-443e-b870-2ddc0bd0d91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:23Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8149bc-32d2-411b-b774-773c91e72746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd8149bc-32d2-411b-b774-773c91e72746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a8a96f-3e8f-434b-86e5-5e6168e44b3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78a8a96f-3e8f-434b-86e5-5e6168e44b3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dcaa17e-589f-443e-b870-2ddc0bd0d91e', 'volume_name': 'volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2e7244-5ec4-43a1-8675-a325ca07b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cc2e7244-5ec4-43a1-8675-a325ca07b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8eb5048-762f-404e-8a55-252c044158e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:22 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume 6dcaa17e-589f-443e-b870-2ddc0bd0d91e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e', 'volume_size': 1} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Created reservations ['e2678ef9-9b20-4ecb-8659-2957953c22ec', '5e884830-b8e9-41e0-bae5-8574f1023166', '1f492b4f-9950-4301-98ec-5483c8d1d111', 'e00f52dc-a2d9-42a9-864e-abcd1a262d61'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:22 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f Jul 06 21:30:22 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:22 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:22 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:23 devstack sudo[106581]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_mnc4pizx" returned: 1 in 0.813s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_mnc4pizx' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[623b93d8-1732-487a-bcfa-bff4c20ef398]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:23 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD Jul 06 21:30:23 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:23 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f" returned: 0 in 0.688s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] <== create_volume: return (2230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.233s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.199s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1172311442',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d68de62-3dea-4d1b-90cf-32d88618eb9b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:12Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Creating volume 2d68de62-3dea-4d1b-90cf-32d88618eb9b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:23 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:23 devstack sudo[106593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b 1073741824 Jul 06 21:30:23 devstack sudo[106593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8513dd3b-ff5e-42ff-a396-ae3d4d3b49a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e987d5bc-3c69-47a8-8165-50aaf699630f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba53c3db-4b46-4134-8655-b34136f4ffa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:23 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.696s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:23 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Deleted volume successfully. Jul 06 21:30:23 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume volume-e987d5bc-3c69-47a8-8165-50aaf699630f (e987d5bc-3c69-47a8-8165-50aaf699630f): created successfully Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba53c3db-4b46-4134-8655-b34136f4ffa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (d46e4897-b467-4257-9318-8998ca74b8e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:23 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d7be696a-9468-46b0-b965-0b54b0c6a43e tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created volume successfully. Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-09353b59-e388-4748-af53-ee699c325d90 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-1f661a67-49e7-4c42-a867-675e983954d0-delete_volume" released by "delete_volume" :: held 3.238s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-2a7141ab-45dd-4577-84d7-0af535fe93d3-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-2a7141ab-45dd-4577-84d7-0af535fe93d3-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-quobyte-2a7141ab-45dd-4577-84d7-0af535fe93d3" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-2a7141ab-45dd-4577-84d7-0af535fe93d3" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[934a1070-a687-4ae1-ad36-0c8af91d25b5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:23 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 Jul 06 21:30:23 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:24 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD" returned: 0 in 0.837s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:24 devstack sudo[106599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD Jul 06 21:30:24 devstack sudo[106599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:24 devstack sudo[106593]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b 1073741824" returned: 0 in 0.921s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:24 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b Jul 06 21:30:24 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:24 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3" returned: 0 in 0.832s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:24 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3 Jul 06 21:30:24 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:24 devstack sudo[106599]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD" returned: 1 in 0.793s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 was raw, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:30:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:24 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 Jul 06 21:30:24 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:25 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b" returned: 0 in 0.669s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] <== create_volume: return (1638ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.641s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.471s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1366171907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=25627720-f808-43bb-ba48-3578fc0ce09a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:13Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Creating volume 25627720-f808-43bb-ba48-3578fc0ce09a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:25 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b33b1da7-0d77-4095-8863-4653c80592dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:25 devstack sudo[106618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a 1073741824 Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68472c-446a-4e08-998d-c61016112383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:25 devstack sudo[106618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:25 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b (2d68de62-3dea-4d1b-90cf-32d88618eb9b): created successfully Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e68472c-446a-4e08-998d-c61016112383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (6d472578-e334-4c55-9057-6e7dffc479ae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:25 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-96a46dd7-65e2-4484-9fa0-91ed684f8bab tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created volume successfully. Jul 06 21:30:25 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2a7141ab-45dd-4577-84d7-0af535fe93d3" returned: 0 in 0.704s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-2a7141ab-45dd-4577-84d7-0af535fe93d3" released by "delete_volume" :: held 1.591s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Created reservations ['59fdd7c9-0e18-4821-b462-5445e8c2f2ad', '39bac96a-e9ae-415b-8bde-99e38701c298', '0fad6161-c782-415c-9235-9f2179386cb3', 'ff2cd050-19dc-404e-9f46-32bb933e357f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:25 devstack sudo[106624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:25 devstack sudo[106624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:25 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03" returned: 0 in 0.766s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_743c6fff-f259-49a7-bcf1-1fd4bb6052c9_d7kmd4esdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:30:25 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 21:30:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:25 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 1G Jul 06 21:30:25 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "cinder-quobyte-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:26 devstack sudo[106618]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a 1073741824" returned: 0 in 1.005s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbd28288-70c7-4c15-8030-5d5929a993ea]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:26 devstack sudo[106633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a Jul 06 21:30:26 devstack sudo[106633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:26 devstack sudo[106624]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.737s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Deleted volume successfully. Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-049a90b0-5e45-4dcc-9a1e-e5f86bdcf8a9 tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-2a7141ab-45dd-4577-84d7-0af535fe93d3-delete_volume" released by "delete_volume" :: held 2.563s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:26 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd Jul 06 21:30:26 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:26 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 1G" returned: 0 in 0.825s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[70c05def-243e-47b8-8dd9-9da703cf54d3]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:26 devstack sudo[106639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 Jul 06 21:30:26 devstack sudo[106639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:26 devstack sudo[106633]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a" returned: 0 in 0.715s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] <== create_volume: return (1784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 13.923s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2128444891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5f3bfae5-012d-4ca3-a90d-d06cee559113,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:13Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Creating volume 5f3bfae5-012d-4ca3-a90d-d06cee559113 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:26 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:27 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 1073741824 Jul 06 21:30:27 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:27 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9c015451-faee-4813-839d-c52e479d1fa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25627720-f808-43bb-ba48-3578fc0ce09a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d51510a-1170-43e3-a4f6-d3f578634682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd" returned: 0 in 0.847s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:27 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume volume-25627720-f808-43bb-ba48-3578fc0ce09a (25627720-f808-43bb-ba48-3578fc0ce09a): created successfully Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d51510a-1170-43e3-a4f6-d3f578634682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (7602ff7d-9085-41cd-af4d-dd43386392fc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:27 devstack sudo[106647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd Jul 06 21:30:27 devstack sudo[106647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f408a75a-c3ba-4586-bad3-32a747905f17 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created volume successfully. Jul 06 21:30:27 devstack sudo[106639]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03" returned: 0 in 0.811s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:27 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 Jul 06 21:30:27 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:27 devstack sudo[106647]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd" returned: 0 in 0.689s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-quobyte-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd" released by "delete_volume" :: held 1.584s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Created reservations ['d42b1730-68ca-4089-a93c-36128d3b4699', 'c3475a5c-25b9-461f-85cb-6b6f97bad0e8', '495a872a-05a5-4255-ad62-faaad1034431', '4278f319-acb9-4870-ba1a-df59cf15ed69'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:27 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 1073741824" returned: 0 in 0.895s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:27 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:27 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:27 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 Jul 06 21:30:27 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:28 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03" returned: 1 in 0.793s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Downloaded image 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 ((None, [{'url': 'file:///opt/stack/data/glance/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'metadata': {}}])) to volume 863bb7e9-9f08-4aaf-b499-00cc08061f03 successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Temporary image 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 for user 430ba398ebbc478c8b6a31bbf9311b71 is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Marking volume 863bb7e9-9f08-4aaf-b499-00cc08061f03 as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Copying metadata from image 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 to 863bb7e9-9f08-4aaf-b499-00cc08061f03. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Creating volume glance metadata for volume 863bb7e9-9f08-4aaf-b499-00cc08061f03 backed by image 743c6fff-f259-49a7-bcf1-1fd4bb6052c9 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'cfdd00a26d90e350e05e73e918d32b6d', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2b7413-57b3-4333-835a-1395938df535) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-863bb7e9-9f08-4aaf-b499-00cc08061f03', 'volume_size': 1, 'image_id': '743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'cfdd00a26d90e350e05e73e918d32b6d', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '35068601065d4246a9bed75df7b08596', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c7fe329b47a198dbaa0a1abdfa958df721c0da872140304f3a1991fde7aa8989ea0a3ea244a6f982c39508d42eab75ec94efd33fb5953626fbe4e94441c61e60', 'id': '743c6fff-f259-49a7-bcf1-1fd4bb6052c9', 'created_at': datetime.datetime(2026, 7, 6, 19, 30, 5, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 30, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/743c6fff-f259-49a7-bcf1-1fd4bb6052c9/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe865c4f-bbca-4e2f-bcdf-3cca3981e70c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Volume volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 (863bb7e9-9f08-4aaf-b499-00cc08061f03): created successfully Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fe865c4f-bbca-4e2f-bcdf-3cca3981e70c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Flow 'volume_create_manager' (7418acc0-9a09-4c41-87ac-0c67af55d653) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2ff2ec67-9d63-468d-b28d-a5180528e3d0 tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Created volume successfully. Jul 06 21:30:28 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Deleted volume successfully. Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ab1916b9-590c-438c-99bd-5b892d97623a tempest-CreateVolumesFromImageTest-1902992813 None] Lock "cinder-6cd5887b-5890-4a2c-91a8-be7aa4e83ccd-delete_volume" released by "delete_volume" :: held 2.564s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Acquiring lock "cinder-863bb7e9-9f08-4aaf-b499-00cc08061f03-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "cinder-863bb7e9-9f08-4aaf-b499-00cc08061f03-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:28 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113" returned: 0 in 0.765s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] <== create_volume: return (1729ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.733s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.327s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-302596535',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b3505ea-4cec-4293-bc59-3fd394d03233,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8a11b5b2bb25461da9fb56d188b98ab7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:13Z,use_quota=True,user_id='12cad275412347f2ac4473d57359c9c9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Creating volume 6b3505ea-4cec-4293-bc59-3fd394d03233 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:28 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Acquiring lock "cinder-quobyte-863bb7e9-9f08-4aaf-b499-00cc08061f03" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:28 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 1073741824 Jul 06 21:30:28 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5993b8ec-66c5-4f89-abc3-e15b20b3c53f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5f3bfae5-012d-4ca3-a90d-d06cee559113', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0280301c-ab92-4f3e-a35e-03284a6945ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "cinder-quobyte-863bb7e9-9f08-4aaf-b499-00cc08061f03" acquired by "delete_volume" :: waited 0.037s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 (5f3bfae5-012d-4ca3-a90d-d06cee559113): created successfully Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0280301c-ab92-4f3e-a35e-03284a6945ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (0b40cb2e-de0b-4ed0-b25d-fc88197dd2be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e08c56ff-eb58-4cb9-bb69-8caff36722b6 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created volume successfully. Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[75044ac7-982f-4d3f-8d91-04d53e6aa7e8]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:28 devstack sudo[106668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 Jul 06 21:30:28 devstack sudo[106668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:29 devstack sudo[106668]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03" returned: 0 in 0.846s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:29 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 1073741824" returned: 0 in 1.023s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:29 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 Jul 06 21:30:29 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:29 devstack sudo[106676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 Jul 06 21:30:29 devstack sudo[106676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:30 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233" returned: 0 in 0.716s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] <== create_volume: return (1789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.791s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.589s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-292351143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4aef0c6d-c98c-46b3-b365-7b098d6430b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:21Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Creating volume 4aef0c6d-c98c-46b3-b365-7b098d6430b4 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:30 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:30 devstack sudo[106676]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03" returned: 1 in 0.852s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:30 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 1073741824 Jul 06 21:30:30 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:30 devstack sudo[106685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03 Jul 06 21:30:30 devstack sudo[106685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (220e7155-454b-46f0-9821-427e08e95899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b3505ea-4cec-4293-bc59-3fd394d03233', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa7e1cd-c756-44af-a98f-473cc44725ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:30 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Volume volume-6b3505ea-4cec-4293-bc59-3fd394d03233 (6b3505ea-4cec-4293-bc59-3fd394d03233): created successfully Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0aa7e1cd-c756-44af-a98f-473cc44725ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Flow 'volume_create_manager' (072d926d-bbcb-4166-8aff-e42ebdb68f88) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-65273afc-8658-4351-942b-99a75c375760 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created volume successfully. Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-6b3505ea-4cec-4293-bc59-3fd394d03233-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-6b3505ea-4cec-4293-bc59-3fd394d03233-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-quobyte-6b3505ea-4cec-4293-bc59-3fd394d03233" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-6b3505ea-4cec-4293-bc59-3fd394d03233" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[61ec1408-8537-4b7e-a910-6363d967797b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:31 devstack sudo[106688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 Jul 06 21:30:31 devstack sudo[106688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:31 devstack sudo[106685]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-863bb7e9-9f08-4aaf-b499-00cc08061f03" returned: 0 in 0.768s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "cinder-quobyte-863bb7e9-9f08-4aaf-b499-00cc08061f03" released by "delete_volume" :: held 2.552s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Created reservations ['d9bbcafc-2214-4bf1-8918-0de2e37a7779', '3c50919b-b9cc-4139-a882-137451f1ca08', 'c6839ba2-86bf-476b-ba41-1eac1423c661', '2857419c-30bc-479f-818c-6d8011f0ef13'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:31 devstack sudo[106695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:31 devstack sudo[106695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:31 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 1073741824" returned: 0 in 1.065s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:31 devstack sudo[106697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 Jul 06 21:30:31 devstack sudo[106697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:31 devstack sudo[106688]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233" returned: 0 in 0.882s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:31 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233 Jul 06 21:30:31 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:32 devstack sudo[106695]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.898s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Deleted volume successfully. Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aa742c0b-6fee-48e0-aec8-049d3cc692fa tempest-VolumeAndVolumeTypeFromImageTest-356828542 None] Lock "cinder-863bb7e9-9f08-4aaf-b499-00cc08061f03-delete_volume" released by "delete_volume" :: held 3.780s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:32 devstack sudo[106697]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4" returned: 0 in 0.856s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] <== create_volume: return (1972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.976s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.114s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1883760423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f16a41c-273d-4e1e-8abc-035db8e5dbc3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:21Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Creating volume 0f16a41c-273d-4e1e-8abc-035db8e5dbc3 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:32 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcdde0b4-165a-40dc-b144-f5326cda4dbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e3cfe9-c595-4e3d-b2fb-9d00f9842f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:32 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 1073741824 Jul 06 21:30:32 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:32 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 (4aef0c6d-c98c-46b3-b365-7b098d6430b4): created successfully Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50e3cfe9-c595-4e3d-b2fb-9d00f9842f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (5788c174-fbaa-4855-afc5-617d37e13865) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-af662651-bf0d-4904-a3a5-f1082d0f21f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created volume successfully. Jul 06 21:30:32 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6b3505ea-4cec-4293-bc59-3fd394d03233" returned: 0 in 0.877s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-6b3505ea-4cec-4293-bc59-3fd394d03233" released by "delete_volume" :: held 1.800s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created reservations ['b106a372-8519-41b1-a831-02a6c65ac867', 'cf7c57ad-70d1-48a5-abfa-b26ac49160c0', 'fab7ec5a-006c-4013-9372-db23414e8692', 'b8a07743-c1b6-4f0e-bb9d-d2895a18a576'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:32 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:32 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-5f3bfae5-012d-4ca3-a90d-d06cee559113-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-5f3bfae5-012d-4ca3-a90d-d06cee559113-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-quobyte-5f3bfae5-012d-4ca3-a90d-d06cee559113" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-5f3bfae5-012d-4ca3-a90d-d06cee559113" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde1c9ce-75fe-4e73-acb2-ccee1dcc5a09]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:33 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 Jul 06 21:30:33 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:33 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 1073741824" returned: 0 in 1.251s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:33 devstack sudo[106719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 Jul 06 21:30:33 devstack sudo[106719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:33 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.970s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:33 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Deleted volume successfully. Jul 06 21:30:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ee953efd-4f00-42d5-8b66-0a85176ae574 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-6b3505ea-4cec-4293-bc59-3fd394d03233-delete_volume" released by "delete_volume" :: held 3.072s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:34 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113" returned: 0 in 0.992s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:34 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113 Jul 06 21:30:34 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:34 devstack sudo[106719]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3" returned: 0 in 0.779s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] <== create_volume: return (2095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.098s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.745s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-2094110522',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d95a5600-b97a-4744-a421-28310dcf7f03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:22Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Creating volume d95a5600-b97a-4744-a421-28310dcf7f03 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:34 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce3d9333-6350-43ad-8330-413bac82d1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380086a4-8b15-42d1-aed6-2e0fae6d7c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:34 devstack sudo[106727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 1073741824 Jul 06 21:30:34 devstack sudo[106727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:34 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 (0f16a41c-273d-4e1e-8abc-035db8e5dbc3): created successfully Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (380086a4-8b15-42d1-aed6-2e0fae6d7c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (6338ce6d-4a27-4732-89f0-7c43ca0fb3fe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8c663751-b07b-459b-8311-e62c7ed1ed5a tempest-CreateVolumesFromSnapshotTest-585573972 None] Created volume successfully. Jul 06 21:30:35 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5f3bfae5-012d-4ca3-a90d-d06cee559113" returned: 0 in 0.971s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-5f3bfae5-012d-4ca3-a90d-d06cee559113" released by "delete_volume" :: held 2.045s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Flow 'volume_create_manager' (91f47497-dc42-4cef-8443-6b9f248a5902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d84c77-d547-4af5-8506-60c0bd13f03f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30d84c77-d547-4af5-8506-60c0bd13f03f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fe06f5-6496-42c3-bc27-89a6aa21e0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab68f9baa562470195eeaf8de30a0a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:35Z,use_quota=True,user_id='2db2a27f849e4e9dbbcb04002f73d763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490cfc43-9357-4cf2-8c6b-cf775b546ce4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (490cfc43-9357-4cf2-8c6b-cf775b546ce4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8b3587-9a01-4ef6-8537-b38e05bcae45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.image.glance [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Creating Keystone auth plugin from conf {{(pid=87273) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created reservations ['c9fb3b0c-37d3-418d-b74a-6f20ba7da1f1', 'f6cbe2db-89e3-4f0f-94a6-6962be133290', '0a3922a1-ac03-40f4-bfbc-6d933417f4ef', '9f0f43ef-960e-4413-a3bd-e8d21aca402e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:35 devstack sudo[106734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:35 devstack sudo[106734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:35 devstack sudo[106727]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 1073741824" returned: 0 in 1.164s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:35 devstack sudo[106736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 Jul 06 21:30:35 devstack sudo[106736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a8b3587-9a01-4ef6-8537-b38e05bcae45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '81fe06f5-6496-42c3-bc27-89a6aa21e0ac', 'volume_name': 'volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac', 'volume_size': 1, 'image_id': '00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3d731615ea088cbb6f74fa03b6f2d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab68f9baa562470195eeaf8de30a0a5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '27df34240d114bbd2a8502ed10e18403ba6e9caf482e4b71cb2c69caed647d4262cc3bd2a728d7ea71d331cc55b535a387113794e560f05dc6ed2a0f04cf6564', 'id': '00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'created_at': datetime.datetime(2026, 7, 6, 19, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7/file', 'properties': {}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d776a87-0347-452f-9686-2d897c6930a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d776a87-0347-452f-9686-2d897c6930a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14504e52-f9ad-48b4-bf12-de8f2ff00b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:35 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Volume 81fe06f5-6496-42c3-bc27-89a6aa21e0ac: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac', 'volume_size': 1, 'image_id': '00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3d731615ea088cbb6f74fa03b6f2d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab68f9baa562470195eeaf8de30a0a5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '27df34240d114bbd2a8502ed10e18403ba6e9caf482e4b71cb2c69caed647d4262cc3bd2a728d7ea71d331cc55b535a387113794e560f05dc6ed2a0f04cf6564', 'id': '00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'created_at': datetime.datetime(2026, 7, 6, 19, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7/file', 'properties': {}}, 'image_service': } Jul 06 21:30:35 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Trying to clone 81fe06f5-6496-42c3-bc27-89a6aa21e0ac from image 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 at location (None, [{'url': 'file:///opt/stack/data/glance/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'metadata': {}}]). {{(pid=87273) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Jul 06 21:30:36 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Image download 0.00 MB at 0.00 MB/s Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc9a7bc2-68e1-44ce-91b4-01a149b1822b]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:36 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD Jul 06 21:30:36 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:36 devstack sudo[106734]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.867s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Deleted volume successfully. Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dfa3c10b-82cc-4941-82f5-747d71dfa52d tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-5f3bfae5-012d-4ca3-a90d-d06cee559113-delete_volume" released by "delete_volume" :: held 3.329s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-25627720-f808-43bb-ba48-3578fc0ce09a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:36 devstack sudo[106736]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03" returned: 0 in 0.827s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] <== create_volume: return (2045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.050s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-25627720-f808-43bb-ba48-3578fc0ce09a-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 14.262s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-618019589',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:22Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Creating volume ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:36 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:36 devstack sudo[106742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae 1073741824 Jul 06 21:30:36 devstack sudo[106742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (980c3cb9-1b33-428d-a397-aab97ead779d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d95a5600-b97a-4744-a421-28310dcf7f03', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3f2889-b0ff-4d75-901b-52c0ab3ec096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:36 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume volume-d95a5600-b97a-4744-a421-28310dcf7f03 (d95a5600-b97a-4744-a421-28310dcf7f03): created successfully Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca3f2889-b0ff-4d75-901b-52c0ab3ec096) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (2ac0afe6-93cc-4ff8-aba0-ff2d7cafec67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7e467327-8e04-4d4d-966c-7f173e6e79af tempest-CreateVolumesFromSnapshotTest-585573972 None] Created volume successfully. Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-quobyte-25627720-f808-43bb-ba48-3578fc0ce09a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-25627720-f808-43bb-ba48-3578fc0ce09a" acquired by "delete_volume" :: waited 0.032s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e7af046-c00a-4974-81c6-f96b4de7ff72]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:37 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a Jul 06 21:30:37 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:37 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD" returned: 0 in 0.883s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:37 devstack sudo[106748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD Jul 06 21:30:37 devstack sudo[106748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:37 devstack sudo[106742]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae 1073741824" returned: 0 in 0.955s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:37 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae Jul 06 21:30:37 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:37 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a" returned: 0 in 1.016s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:37 devstack sudo[106762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a Jul 06 21:30:37 devstack sudo[106762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:37 devstack sudo[106748]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD" returned: 1 in 0.867s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:37 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Temporary image 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 is fetched for user 2db2a27f849e4e9dbbcb04002f73d763. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4221c679-0650-4724-b9ee-c8d35f329e18]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:38 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD Jul 06 21:30:38 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:38 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae" returned: 0 in 0.805s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] <== create_volume: return (1810ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.815s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 15.687s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-692481825',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dcaa17e-589f-443e-b870-2ddc0bd0d91e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26b4a6809d6845a3b1a78b645d402511',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:23Z,use_quota=True,user_id='21d8a427c913464d983175916ccf00a2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Creating volume 6dcaa17e-589f-443e-b870-2ddc0bd0d91e {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:38 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c02ebb29-68c8-4f11-b143-65e65175ca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:38 devstack sudo[106767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e 1073741824 Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b390ac65-3d0e-46cd-a24c-60be97957a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:38 devstack sudo[106767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:38 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae (ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae): created successfully Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b390ac65-3d0e-46cd-a24c-60be97957a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (2df34e01-e877-48c3-8b86-8564812206a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b9aeb876-66ad-4819-b529-4def949d6dd1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created volume successfully. Jul 06 21:30:38 devstack sudo[106762]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-25627720-f808-43bb-ba48-3578fc0ce09a" returned: 0 in 0.766s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-25627720-f808-43bb-ba48-3578fc0ce09a" released by "delete_volume" :: held 1.852s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created reservations ['23255f0a-5e75-42a9-9e55-cff902f0d45d', '29f0578e-f107-48a0-9dd9-90343320f27c', '48217475-fcc3-4196-86b9-3692bfaa65fe', '45fe4301-e57a-4a3b-970c-be44e4a765ea'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:38 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:38 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-2d68de62-3dea-4d1b-90cf-32d88618eb9b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-2d68de62-3dea-4d1b-90cf-32d88618eb9b-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:39 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD" returned: 0 in 0.942s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-quobyte-2d68de62-3dea-4d1b-90cf-32d88618eb9b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-2d68de62-3dea-4d1b-90cf-32d88618eb9b" acquired by "delete_volume" :: waited 0.035s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8b9fd39-d218-4164-b2a6-c88cb9be15bb]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:39 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD Jul 06 21:30:39 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:39 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b Jul 06 21:30:39 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:39 devstack sudo[106767]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e 1073741824" returned: 0 in 1.150s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:39 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.830s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Deleted volume successfully. Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ad2dc47a-1992-4940-910e-a73ffbd02294 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-25627720-f808-43bb-ba48-3578fc0ce09a-delete_volume" released by "delete_volume" :: held 3.057s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:39 devstack sudo[106783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e Jul 06 21:30:39 devstack sudo[106783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:39 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD" returned: 1 in 0.973s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:40 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b" returned: 0 in 0.993s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:40 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b Jul 06 21:30:40 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:40 devstack sudo[106783]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e" returned: 0 in 0.724s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] <== create_volume: return (1956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.961s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.433s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:35Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81fe06f5-6496-42c3-bc27-89a6aa21e0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab68f9baa562470195eeaf8de30a0a5d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:35Z,use_quota=True,user_id='2db2a27f849e4e9dbbcb04002f73d763',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Creating volume 81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:40 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8eb5048-762f-404e-8a55-252c044158e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:40 devstack sudo[106795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac 1073741824 Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6276d92-279d-4735-bb1c-bb94d06d3353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:40 devstack sudo[106795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:40 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Volume volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e (6dcaa17e-589f-443e-b870-2ddc0bd0d91e): created successfully Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6276d92-279d-4735-bb1c-bb94d06d3353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Flow 'volume_create_manager' (93ae456d-2585-4921-8971-cd357065c225) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:40 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e4ad97bc-4b36-488e-b5d7-0b80c51488b4 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created volume successfully. Jul 06 21:30:40 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2d68de62-3dea-4d1b-90cf-32d88618eb9b" returned: 0 in 0.748s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-2d68de62-3dea-4d1b-90cf-32d88618eb9b" released by "delete_volume" :: held 1.814s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:40 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created reservations ['80015934-a2fc-4079-8d97-0c983f0a907f', '7a371075-fd69-441e-97d7-55cafd10cee4', '0f52493f-4a1e-4942-b481-c81acc1acd5b', 'faef0763-fd68-474a-8d83-7f19e54ad435'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:41 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:41 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-e987d5bc-3c69-47a8-8165-50aaf699630f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-e987d5bc-3c69-47a8-8165-50aaf699630f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-quobyte-e987d5bc-3c69-47a8-8165-50aaf699630f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-e987d5bc-3c69-47a8-8165-50aaf699630f" acquired by "delete_volume" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc3c4b9e-2a7b-4393-b89d-1edc87068b19]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-6dcaa17e-589f-443e-b870-2ddc0bd0d91e-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:41 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f Jul 06 21:30:41 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-6dcaa17e-589f-443e-b870-2ddc0bd0d91e-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:41 devstack sudo[106795]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac 1073741824" returned: 0 in 1.135s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-6dcaa17e-589f-443e-b870-2ddc0bd0d91e" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-6dcaa17e-589f-443e-b870-2ddc0bd0d91e" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:41 devstack sudo[106806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac Jul 06 21:30:41 devstack sudo[106806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a659079-fad6-4191-be4e-81a9f501bfad]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:41 devstack sudo[106808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e Jul 06 21:30:41 devstack sudo[106808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:42 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.081s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Deleted volume successfully. Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6c104a62-d895-4bbf-a018-46660d5e7b30 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-2d68de62-3dea-4d1b-90cf-32d88618eb9b-delete_volume" released by "delete_volume" :: held 3.204s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:42 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f" returned: 0 in 1.035s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:42 devstack sudo[106816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f Jul 06 21:30:42 devstack sudo[106816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:42 devstack sudo[106806]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" returned: 0 in 0.934s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] <== create_volume: return (2139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.143s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Attempting download of 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'metadata': {}}])) to volume 81fe06f5-6496-42c3-bc27-89a6aa21e0ac. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e211a43d-d2f3-4f07-8cde-fb89e37d801e]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_40gy254m {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:42 devstack sudo[106820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_40gy254m Jul 06 21:30:42 devstack sudo[106820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:42 devstack sudo[106808]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e" returned: 0 in 1.094s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:42 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e Jul 06 21:30:42 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:43 devstack sudo[106816]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e987d5bc-3c69-47a8-8165-50aaf699630f" returned: 0 in 0.773s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-e987d5bc-3c69-47a8-8165-50aaf699630f" released by "delete_volume" :: held 1.872s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created reservations ['0a01a971-a85f-4e4f-ab92-1331b2464d53', '711e9aea-7ae5-445f-b652-77094045e7a9', '2bd1af0c-1afa-403e-ba9e-c3884fe4829e', '5568b5c9-4775-48f4-a36a-c30d8739277d'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:43 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:43 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:43 devstack sudo[106820]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_40gy254m" returned: 0 in 0.814s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_40gy254m {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:43 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_40gy254m Jul 06 21:30:43 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:43 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6dcaa17e-589f-443e-b870-2ddc0bd0d91e" returned: 0 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-6dcaa17e-589f-443e-b870-2ddc0bd0d91e" released by "delete_volume" :: held 1.992s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "cinder-quobyte-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6" acquired by "delete_volume" :: waited 0.034s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[065b26e1-ad66-4236-a32e-5c1ca7c1a2bd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created reservations ['b693d469-1670-4c67-8105-f384d776c255', 'f0f7379e-e93e-45a6-96c2-fac08d92051a', '8b1af238-4cdf-4b07-a490-46b0de527012', 'aa10e28e-12b0-4fc5-87b0-a5a0a2b53804'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:43 devstack sudo[106833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 Jul 06 21:30:43 devstack sudo[106833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:43 devstack sudo[106834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:43 devstack sudo[106834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:44 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:44 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.116s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_40gy254m" returned: 1 in 1.039s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_40gy254m' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Deleted volume successfully. Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[49f58646-e4a7-4ab4-a72a-7e453aea44c3]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (36ca97b6-c68f-4772-9045-c49dd5fe60d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4712710f-896f-4c81-a201-a1ea1b918111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ed4e5aa5-1b62-4c87-bee4-a875f86bfe04 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-e987d5bc-3c69-47a8-8165-50aaf699630f-delete_volume" released by "delete_volume" :: held 3.359s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4712710f-896f-4c81-a201-a1ea1b918111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324812317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ffbc76-2b84-4f59-bc09-a4b08008f723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:44Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d94425b-9c0a-40e0-a1bd-37787f9560a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d94425b-9c0a-40e0-a1bd-37787f9560a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265c30fe-cd7c-4bc0-b08f-ce2c91e47fd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (265c30fe-cd7c-4bc0-b08f-ce2c91e47fd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83ffbc76-2b84-4f59-bc09-a4b08008f723', 'volume_name': 'volume-83ffbc76-2b84-4f59-bc09-a4b08008f723', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992b5857-8143-4ded-ba60-c1a6fe6164a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (992b5857-8143-4ded-ba60-c1a6fe6164a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:44 devstack sudo[106840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD Jul 06 21:30:44 devstack sudo[106840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a96fa0-cfa2-4a09-89ae-845cf9809b41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:44 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Volume 83ffbc76-2b84-4f59-bc09-a4b08008f723: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83ffbc76-2b84-4f59-bc09-a4b08008f723', 'volume_size': 1} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324812317',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83ffbc76-2b84-4f59-bc09-a4b08008f723,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:30:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:30:44Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Creating volume 83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:44 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:44 devstack sudo[106834]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.804s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:44 devstack sudo[106845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 1073741824 Jul 06 21:30:44 devstack sudo[106845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:44 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Deleted volume successfully. Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e6f5cc27-34a7-4160-9d8e-e15ad5bde3a1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-6dcaa17e-589f-443e-b870-2ddc0bd0d91e-delete_volume" released by "delete_volume" :: held 3.218s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:44 devstack sudo[106833]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6" returned: 0 in 1.100s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:44 devstack sudo[106849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6 Jul 06 21:30:44 devstack sudo[106849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d77721ee-fb49-4848-bab0-31f9e4123be6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:45 devstack sudo[106851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae Jul 06 21:30:45 devstack sudo[106851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:45 devstack sudo[106840]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD" returned: 0 in 0.886s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:45 devstack sudo[106858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD Jul 06 21:30:45 devstack sudo[106858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:45 devstack sudo[106845]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 1073741824" returned: 0 in 0.986s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:45 devstack sudo[106849]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6" returned: 0 in 0.832s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-quobyte-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6" released by "delete_volume" :: held 2.001s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:45 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 Jul 06 21:30:45 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Created reservations ['80bc5d15-c510-4a36-85ca-b6698635f70b', 'f0244887-e4b2-4d28-8d94-93741c6227ed', '104c16fe-3308-4a88-bf29-1f0ec89e6741', '685bc00b-ec15-41ce-b6b1-db8f204b955d'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:45 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:45 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:46 devstack sudo[106851]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae" returned: 0 in 0.906s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:46 devstack sudo[106870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae Jul 06 21:30:46 devstack sudo[106870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:46 devstack sudo[106858]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD" returned: 1 in 0.822s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 was raw, converting to raw {{(pid=87273) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:46 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac Jul 06 21:30:46 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:46 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723" returned: 0 in 0.816s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] <== create_volume: return (1870ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.877s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:46 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5a96fa0-cfa2-4a09-89ae-845cf9809b41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83ffbc76-2b84-4f59-bc09-a4b08008f723', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ad707c-b593-4c2c-8dec-e4b7bb821c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.701s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Deleted volume successfully. Jul 06 21:30:46 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Volume volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 (83ffbc76-2b84-4f59-bc09-a4b08008f723): created successfully Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (66ad707c-b593-4c2c-8dec-e4b7bb821c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (36ca97b6-c68f-4772-9045-c49dd5fe60d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f4d8df30-37e7-4ac5-a2d7-2eb48b547916 tempest-ProjectReaderTests-1163838596 None] Created volume successfully. Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-5afd70c2-1bba-4b03-b176-307e02313825 tempest-CreateVolumesFromSourceVolumeTest-1199975121 None] Lock "cinder-6e0103aa-a70d-4919-8ef3-e15bd29ba4e6-delete_volume" released by "delete_volume" :: held 3.037s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:46 devstack sudo[106870]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae" returned: 0 in 0.757s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae" released by "delete_volume" :: held 1.711s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created reservations ['9686408d-e63a-4e6c-838a-7699771d7c24', '51125205-0caa-4b39-a5dc-9c4f19165ae7', 'fa142494-94d5-466f-a898-364b83effb1c', 'a3a00066-82c5-442d-846d-aedcbb9c1d39'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:46 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:46 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:47 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" returned: 0 in 0.843s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_00a1ffab-a4be-4c14-ba97-734ddff5c3c7_0kgh2rb6devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:30:47 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Converted 0.00 MB image at 0.00 MB/s Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:47 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac 1G Jul 06 21:30:47 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-d95a5600-b97a-4744-a421-28310dcf7f03-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-d95a5600-b97a-4744-a421-28310dcf7f03-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-d95a5600-b97a-4744-a421-28310dcf7f03" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-d95a5600-b97a-4744-a421-28310dcf7f03" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[92860b0b-d10a-4ee2-a1bf-110a1d8cab60]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:47 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 Jul 06 21:30:47 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:47 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.826s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:47 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Deleted volume successfully. Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1c983dc5-2334-4d2c-9659-b7a157aff0f8 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-ac88d68f-cb65-4da5-af7f-b6ccf87ac8ae-delete_volume" released by "delete_volume" :: held 2.795s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:47 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac 1G" returned: 0 in 0.817s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[4eac9c7d-3818-40c1-86ae-2e8490f386ec]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Creating offline snapshot 636dc6e5-1f65-40a5-8eca-1e450c8ddb99 of volume 83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:30:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[83f1921c-b3e9-40cd-810a-9e8c4771e138]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:48 devstack sudo[106893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac Jul 06 21:30:48 devstack sudo[106893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:48 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 Jul 06 21:30:48 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:48 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03" returned: 0 in 1.070s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:48 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03 Jul 06 21:30:48 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:48 devstack sudo[106893]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" returned: 0 in 1.051s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:49 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723" returned: 0 in 0.949s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:49 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 1G Jul 06 21:30:49 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:49 devstack sudo[106909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac Jul 06 21:30:49 devstack sudo[106909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:49 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d95a5600-b97a-4744-a421-28310dcf7f03" returned: 0 in 0.775s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-d95a5600-b97a-4744-a421-28310dcf7f03" released by "delete_volume" :: held 1.909s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created reservations ['76042d49-7905-4192-aee1-7b6824e30b63', '934e3b84-fc4a-44da-a078-6baccd887535', '876f73e4-587c-4934-8f80-ff9eec3140f1', '01424627-da7d-4803-af8b-94b32961bb5b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:49 devstack sudo[106914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:49 devstack sudo[106914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-0f16a41c-273d-4e1e-8abc-035db8e5dbc3-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-0f16a41c-273d-4e1e-8abc-035db8e5dbc3-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-0f16a41c-273d-4e1e-8abc-035db8e5dbc3" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-0f16a41c-273d-4e1e-8abc-035db8e5dbc3" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[638f7701-8755-44a4-ae5d-6cf1e1267dbd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:49 devstack sudo[106909]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" returned: 1 in 0.992s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Downloaded image 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 ((None, [{'url': 'file:///opt/stack/data/glance/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'metadata': {}}])) to volume 81fe06f5-6496-42c3-bc27-89a6aa21e0ac successfully. {{(pid=87273) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Temporary image 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 for user 2db2a27f849e4e9dbbcb04002f73d763 is deleted. {{(pid=87273) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.volume_utils [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Marking volume 81fe06f5-6496-42c3-bc27-89a6aa21e0ac as bootable. {{(pid=87273) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Jul 06 21:30:50 devstack sudo[106922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 Jul 06 21:30:50 devstack sudo[106922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Copying metadata from image 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 to 81fe06f5-6496-42c3-bc27-89a6aa21e0ac. {{(pid=87273) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Creating volume glance metadata for volume 81fe06f5-6496-42c3-bc27-89a6aa21e0ac backed by image 00a1ffab-a4be-4c14-ba97-734ddff5c3c7 with: {'image_id': '00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4d3d731615ea088cbb6f74fa03b6f2d3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87273) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (14504e52-f9ad-48b4-bf12-de8f2ff00b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac', 'volume_size': 1, 'image_id': '00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4d3d731615ea088cbb6f74fa03b6f2d3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ab68f9baa562470195eeaf8de30a0a5d', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '27df34240d114bbd2a8502ed10e18403ba6e9caf482e4b71cb2c69caed647d4262cc3bd2a728d7ea71d331cc55b535a387113794e560f05dc6ed2a0f04cf6564', 'id': '00a1ffab-a4be-4c14-ba97-734ddff5c3c7', 'created_at': datetime.datetime(2026, 7, 6, 19, 30, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 7, 6, 19, 30, 34, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/00a1ffab-a4be-4c14-ba97-734ddff5c3c7/file', 'properties': {}}, 'image_service': }' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98b9ef0-2b12-47e6-923d-0dd4cd60d59b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:50 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 1G" returned: 0 in 1.092s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:50 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Volume volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac (81fe06f5-6496-42c3-bc27-89a6aa21e0ac): created successfully Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b98b9ef0-2b12-47e6-923d-0dd4cd60d59b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Flow 'volume_create_manager' (91f47497-dc42-4cef-8443-6b9f248a5902) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:50 devstack sudo[106924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 Jul 06 21:30:50 devstack sudo[106924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4448ef75-71ff-4d14-b78b-54345afd22df tempest-VolumeImageDependencyTests-1093126132 None] Created volume successfully. Jul 06 21:30:50 devstack sudo[106914]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.934s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Deleted volume successfully. Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d845f734-3469-44ff-a8c0-30f024f984d1 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-d95a5600-b97a-4744-a421-28310dcf7f03-delete_volume" released by "delete_volume" :: held 3.117s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:50 devstack sudo[106922]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3" returned: 0 in 0.958s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:50 devstack sudo[106932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3 Jul 06 21:30:50 devstack sudo[106932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:50 devstack sudo[106924]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99" returned: 0 in 0.797s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:50 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 is being set with open permissions: ugo+rw Jul 06 21:30:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:51 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 Jul 06 21:30:51 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Acquiring lock "cinder-81fe06f5-6496-42c3-bc27-89a6aa21e0ac-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Lock "cinder-81fe06f5-6496-42c3-bc27-89a6aa21e0ac-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Acquiring lock "cinder-quobyte-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Lock "cinder-quobyte-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dc70299-c2cc-4759-992b-c67284244c4a]: (4, 'raw') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:51 devstack sudo[106938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac Jul 06 21:30:51 devstack sudo[106938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:51 devstack sudo[106932]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0f16a41c-273d-4e1e-8abc-035db8e5dbc3" returned: 0 in 0.824s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-0f16a41c-273d-4e1e-8abc-035db8e5dbc3" released by "delete_volume" :: held 1.840s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Created reservations ['5482f0df-d7f3-4977-9a94-977ea3b04b13', 'b2993197-8330-47f8-a114-1385efd259e0', 'e267e807-b280-42da-9d22-ed21b0131d0e', 'b7733aba-e964-45ad-b5c0-adc3dd61d354'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:51 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99" returned: 0 in 0.780s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:51 devstack sudo[106942]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:51 devstack sudo[106942]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:51 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.info Jul 06 21:30:51 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-4aef0c6d-c98c-46b3-b365-7b098d6430b4-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-4aef0c6d-c98c-46b3-b365-7b098d6430b4-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-4aef0c6d-c98c-46b3-b365-7b098d6430b4" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-4aef0c6d-c98c-46b3-b365-7b098d6430b4" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[23380177-3bef-47bf-8116-2acf995196e6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:52 devstack sudo[106948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 Jul 06 21:30:52 devstack sudo[106948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:52 devstack sudo[106938]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" returned: 0 in 0.867s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:52 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac Jul 06 21:30:52 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:52 devstack sudo[106942]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.926s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:52 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Deleted volume successfully. Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-49441841-a872-4ef3-9a5a-1305145db49b tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-0f16a41c-273d-4e1e-8abc-035db8e5dbc3-delete_volume" released by "delete_volume" :: held 3.001s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:52 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.info" returned: 0 in 0.982s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:52 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.info is being set with open permissions: ugo+rw Jul 06 21:30:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:52 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.info Jul 06 21:30:52 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:53 devstack sudo[106948]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4" returned: 0 in 1.147s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:53 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4 Jul 06 21:30:53 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:53 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" returned: 1 in 1.160s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac' failed. Not Retrying. {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Jul 06 21:30:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:53 devstack sudo[107000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac Jul 06 21:30:53 devstack sudo[107000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:53 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.info" returned: 0 in 1.023s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.774s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:53 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7a44c8cb-4b5f-4d25-bf21-431ad129440b tempest-ProjectReaderTests-1163838596 None] Create snapshot completed successfully Jul 06 21:30:54 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4aef0c6d-c98c-46b3-b365-7b098d6430b4" returned: 0 in 0.774s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-4aef0c6d-c98c-46b3-b365-7b098d6430b4" released by "delete_volume" :: held 1.986s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Created reservations ['87aea7c0-e39c-4afb-ab1f-e0c0ce763eb4', '8e70fa1a-14fe-452a-91ea-44c62b3725d7', '4c563bba-295b-483a-ae93-f86885a1942c', '6d2b7de5-0870-44a8-bdf9-c55cc9422d4e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:54 devstack sudo[107005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:54 devstack sudo[107005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:54 devstack sudo[107000]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Lock "cinder-quobyte-81fe06f5-6496-42c3-bc27-89a6aa21e0ac" released by "delete_volume" :: held 2.870s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-202be8d5-eb34-4784-b44b-c807ba7afaeb-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-202be8d5-eb34-4784-b44b-c807ba7afaeb-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Created reservations ['39c11e27-ee48-4a69-9dff-ea317aec20ec', '69927c81-9a68-471d-b563-ad6d69731930', '5af15323-f2ed-441d-a171-09c908630a9c', 'a24f8f55-81ab-4e38-a19b-7fe918d500be'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-202be8d5-eb34-4784-b44b-c807ba7afaeb" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-202be8d5-eb34-4784-b44b-c807ba7afaeb" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Deleting offline snapshot 202be8d5-eb34-4784-b44b-c807ba7afaeb of volume 56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] snapshot_file for this snap is: volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3f3390-dcc9-4712-9357-8a3999df7146]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:54 devstack sudo[107008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:30:54 devstack sudo[107008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:54 devstack sudo[107007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb Jul 06 21:30:54 devstack sudo[107007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-636dc6e5-1f65-40a5-8eca-1e450c8ddb99-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Lock "cinder-636dc6e5-1f65-40a5-8eca-1e450c8ddb99-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-83ffbc76-2b84-4f59-bc09-a4b08008f723" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-83ffbc76-2b84-4f59-bc09-a4b08008f723" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-636dc6e5-1f65-40a5-8eca-1e450c8ddb99" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-636dc6e5-1f65-40a5-8eca-1e450c8ddb99" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Deleting offline snapshot 636dc6e5-1f65-40a5-8eca-1e450c8ddb99 of volume 83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] snapshot_file for this snap is: volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6db7b5d-527f-450c-b06c-bdd47c01b2c1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:55 devstack sudo[107005]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.861s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:55 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Deleted volume successfully. Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b2a490d3-ccbf-4dfe-86a4-0181187a0ccd tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-4aef0c6d-c98c-46b3-b365-7b098d6430b4-delete_volume" released by "delete_volume" :: held 3.118s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:55 devstack sudo[107012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 Jul 06 21:30:55 devstack sudo[107012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:55 devstack sudo[107007]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb" returned: 0 in 1.100s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d4675a0-154e-42f5-9d78-e4f2f54fdc10]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:55 devstack sudo[107008]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.171s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:30:55 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Deleted volume successfully. Jul 06 21:30:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-85f26379-a65e-43be-8a8d-e5c46e8e57c6 tempest-VolumeImageDependencyTests-1093126132 None] Lock "cinder-81fe06f5-6496-42c3-bc27-89a6aa21e0ac-delete_volume" released by "delete_volume" :: held 4.412s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:55 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 Jul 06 21:30:55 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:56 devstack sudo[107012]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99" returned: 0 in 1.188s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-83ffbc76-2b84-4f59-bc09-a4b08008f723(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d436452d-0018-4163-bd63-85327bcf7a6d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:56 devstack sudo[107025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 Jul 06 21:30:56 devstack sudo[107025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:56 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" returned: 0 in 0.960s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:56 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb Jul 06 21:30:56 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:56 devstack sudo[107025]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723" returned: 0 in 0.836s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:56 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 Jul 06 21:30:56 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:57 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb" returned: 0 in 0.897s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:57 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb Jul 06 21:30:57 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:57 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99" returned: 0 in 0.892s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:57 devstack sudo[107053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99 Jul 06 21:30:57 devstack sudo[107053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:58 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2.202be8d5-eb34-4784-b44b-c807ba7afaeb" returned: 0 in 0.885s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=152,cinder:UPDATE=201,cinder:INSERT=54,cinder:DELETE=17 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=219,cinder:SELECT=145,cinder:INSERT=59,cinder:DELETE=23 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-202be8d5-eb34-4784-b44b-c807ba7afaeb" released by "_delete_snapshot" :: held 4.037s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" released by "delete_snapshot" :: held 4.086s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created reservations ['401c8562-9de7-4c1b-864c-7d05ddbc4a5d', '01e94320-918c-4d38-957c-dbe9e497aafe', 'e0ff5497-cb7b-4439-a4d5-1a59c737973a', '78ad1b3b-e436-49d6-a297-6857326deb43'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Delete snapshot completed successfully. Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-cd156952-178e-468b-ba37-f60628579305 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-202be8d5-eb34-4784-b44b-c807ba7afaeb-delete_snapshot" released by "delete_snapshot" :: held 4.341s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:58 devstack sudo[107053]: pam_unix(sudo:session): session closed for user root Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723.636dc6e5-1f65-40a5-8eca-1e450c8ddb99" returned: 0 in 1.008s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-636dc6e5-1f65-40a5-8eca-1e450c8ddb99" released by "_delete_snapshot" :: held 4.105s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-83ffbc76-2b84-4f59-bc09-a4b08008f723" released by "delete_snapshot" :: held 4.161s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:58 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Created reservations ['3148ca78-5203-4067-8af2-da8d35e5e721', 'f22bd8e9-0791-4886-a0e6-b7cd33f66fd1', '089f5d9c-963b-4d41-9ddc-4869c3a59918', 'afe68115-1629-4f43-8d89-5cee6f167672'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:30:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Delete snapshot completed successfully. Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-e7f7301c-7e4f-4de9-aa22-d8e73019a74c tempest-ProjectReaderTests-1163838596 None] Lock "cinder-636dc6e5-1f65-40a5-8eca-1e450c8ddb99-delete_snapshot" released by "delete_snapshot" :: held 4.390s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-56097d7f-e94a-4bc4-8786-ffd3d9184dc2-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-56097d7f-e94a-4bc4-8786-ffd3d9184dc2-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "cinder-quobyte-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[651bce2c-b7b1-4464-a41f-84ad1d6b5873]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (ceca108b-d769-4a4c-a4e4-9ee908ca6a66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8390ea6-e3fa-420f-b0d4-7dae30c89900) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d8390ea6-e3fa-420f-b0d4-7dae30c89900) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207935887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7c3c72-e3e7-4d74-be92-2b690959ff4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:00Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7ff0ae-593a-4003-b0f3-82e69b00fa31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a7ff0ae-593a-4003-b0f3-82e69b00fa31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592f5c86-44cd-45a2-8623-a4e5edcddc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (592f5c86-44cd-45a2-8623-a4e5edcddc7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7c3c72-e3e7-4d74-be92-2b690959ff4c', 'volume_name': 'volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d0bed7-3de2-4e7d-b502-517ad7cc48c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (08d0bed7-3de2-4e7d-b502-517ad7cc48c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:30:59 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 Jul 06 21:30:59 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c59101-f6f9-48d1-be32-24466a4471d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:30:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Volume 6d7c3c72-e3e7-4d74-be92-2b690959ff4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c', 'volume_size': 1} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:30:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1207935887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7c3c72-e3e7-4d74-be92-2b690959ff4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:00Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Creating volume 6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:30:59 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:30:59 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c 1073741824 Jul 06 21:30:59 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:30:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-83ffbc76-2b84-4f59-bc09-a4b08008f723-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Lock "cinder-83ffbc76-2b84-4f59-bc09-a4b08008f723-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-83ffbc76-2b84-4f59-bc09-a4b08008f723" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-83ffbc76-2b84-4f59-bc09-a4b08008f723" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d1fe7bc-0627-4920-8f21-4b787791b0f5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:00 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 Jul 06 21:31:00 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:00 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" returned: 0 in 0.876s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:00 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2 Jul 06 21:31:00 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:00 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c 1073741824" returned: 0 in 1.094s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:01 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:01 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c Jul 06 21:31:01 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723" returned: 0 in 0.903s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:01 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723 Jul 06 21:31:01 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:01 devstack sudo[107085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:01 devstack sudo[107085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:01 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-quobyte-56097d7f-e94a-4bc4-8786-ffd3d9184dc2" released by "delete_volume" :: held 1.808s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Created reservations ['86e6ff84-4e11-4616-93d9-f7f94ae7b27b', '9e5e05e7-a335-4992-893b-ede2c97a9b05', 'd3f29378-c3ab-4150-a66b-55296c53b635', '630580a5-cbb1-4393-993e-d050e47a9117'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:01 devstack sudo[107088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:01 devstack sudo[107088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:01 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" returned: 0 in 0.962s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (2108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.120s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a0c59101-f6f9-48d1-be32-24466a4471d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fe45ed-da7e-4b91-8e8d-85de54558583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:02 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Volume volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c (6d7c3c72-e3e7-4d74-be92-2b690959ff4c): created successfully Jul 06 21:31:02 devstack sudo[107085]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1fe45ed-da7e-4b91-8e8d-85de54558583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (ceca108b-d769-4a4c-a4e4-9ee908ca6a66) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-83ffbc76-2b84-4f59-bc09-a4b08008f723" returned: 0 in 1.047s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.954s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-03a3c014-d5da-4aae-b43d-6d860a6bb0bc tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 28 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-83ffbc76-2b84-4f59-bc09-a4b08008f723" released by "delete_volume" :: held 2.054s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Created reservations ['91b98f3e-43ca-4aa2-bb3d-a87bd47545aa', 'f023eda3-8a6a-482f-8ca0-cde5b298497a', '3a3f9349-f747-4c6c-8441-8e79fca2fcac', '7f76d2a3-1623-41cf-bd91-c3bd3f755fa9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:02 devstack sudo[107093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:02 devstack sudo[107093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Flow 'volume_create_manager' (374bbc91-342d-42d5-8206-2a3b0a9ab201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc32fb49-75a7-4a38-ad0d-650793281826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc32fb49-75a7-4a38-ad0d-650793281826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923644314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e85dc4-05b1-4679-8327-746dd5aa5edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7368a71eb13c44d0ad38a5801a31f690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:03Z,use_quota=True,user_id='cff6adde5f68458699ca706d75114e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2bbfe3-f6ed-48e9-833e-c98aa203e888) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2d2bbfe3-f6ed-48e9-833e-c98aa203e888) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bff30d0-3f9f-44b4-8018-b76df77f1bb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5bff30d0-3f9f-44b4-8018-b76df77f1bb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd9e85dc4-05b1-4679-8327-746dd5aa5edf', 'volume_name': 'volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e745e3-8789-4084-9422-62eafc8ebcff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1e745e3-8789-4084-9422-62eafc8ebcff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f49eca5-e70a-4fe0-b3b9-eab4b3883b10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Volume d9e85dc4-05b1-4679-8327-746dd5aa5edf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf', 'volume_size': 1} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-923644314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d9e85dc4-05b1-4679-8327-746dd5aa5edf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7368a71eb13c44d0ad38a5801a31f690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:03Z,use_quota=True,user_id='cff6adde5f68458699ca706d75114e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Creating volume d9e85dc4-05b1-4679-8327-746dd5aa5edf {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:02 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:02 devstack sudo[107088]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.081s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:02 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf 1073741824 Jul 06 21:31:02 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Deleted volume successfully. Jul 06 21:31:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-f7426f00-2992-4b60-882d-0d04aa061972 tempest-CreateVolumesFromSnapshotTest-585573972 None] Lock "cinder-56097d7f-e94a-4bc4-8786-ffd3d9184dc2-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (065f68e4-3a7e-4f5f-bd5c-21075f0ff0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ecaf37-3fe3-4c1b-93bf-b4b90f82416d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43ecaf37-3fe3-4c1b-93bf-b4b90f82416d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599557833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4fce34-3c35-4d7f-8ed2-151b55775f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:03Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef9e6a7-509a-4e37-8d39-6a16a97d6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ef9e6a7-509a-4e37-8d39-6a16a97d6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eedff0-7f0c-4b83-8e7e-d20b948d8a7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33eedff0-7f0c-4b83-8e7e-d20b948d8a7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e4fce34-3c35-4d7f-8ed2-151b55775f92', 'volume_name': 'volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f889116-5b9a-4498-8ddc-a805cb05a0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f889116-5b9a-4498-8ddc-a805cb05a0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b10f6e9-b15b-4213-a286-0eaba6ed3458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Volume 3e4fce34-3c35-4d7f-8ed2-151b55775f92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92', 'volume_size': 1} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:03 devstack sudo[107093]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.010s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Deleted volume successfully. Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-156cf52e-f49a-4bb6-9fd6-474f28b8c60e tempest-ProjectReaderTests-1163838596 None] Lock "cinder-83ffbc76-2b84-4f59-bc09-a4b08008f723-delete_volume" released by "delete_volume" :: held 3.371s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:03 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf 1073741824" returned: 0 in 1.148s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:03 devstack sudo[107103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf Jul 06 21:31:03 devstack sudo[107103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:04 devstack sudo[107103]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf" returned: 0 in 0.708s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] <== create_volume: return (1906ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.909s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.413s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1599557833',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e4fce34-3c35-4d7f-8ed2-151b55775f92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:03Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Creating volume 3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:04 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f49eca5-e70a-4fe0-b3b9-eab4b3883b10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:04 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 1073741824 Jul 06 21:31:04 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c29a65-3418-4eb1-9833-e9972a7ea791) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:04 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Volume volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf (d9e85dc4-05b1-4679-8327-746dd5aa5edf): created successfully Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4c29a65-3418-4eb1-9833-e9972a7ea791) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:04 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Flow 'volume_create_manager' (374bbc91-342d-42d5-8206-2a3b0a9ab201) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:04 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-dbf79a49-664d-4e99-a632-12f68d2ebd7c tempest-ProjectReaderTests-1313226364 None] Created volume successfully. Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Flow 'volume_create_manager' (f8e1f804-a3f1-4ddd-ba69-327ab089d58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1897ce62-93ec-4734-8004-67c2a1ab621a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1897ce62-93ec-4734-8004-67c2a1ab621a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144061748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0922f03e-931c-4e2c-b4b0-db067b01768f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45a68f3593e4fb9910f033adfec61ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:05Z,use_quota=True,user_id='9a37e49f17f340cbb7ee1114fc8beb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14556a95-54cb-4203-8fd0-42eed2e42781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (14556a95-54cb-4203-8fd0-42eed2e42781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfdd01b-f3c1-46ec-b1fd-f1e76f0457fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbfdd01b-f3c1-46ec-b1fd-f1e76f0457fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0922f03e-931c-4e2c-b4b0-db067b01768f', 'volume_name': 'volume-0922f03e-931c-4e2c-b4b0-db067b01768f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af42fbbb-f62d-4510-8479-d1713ed92c1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (af42fbbb-f62d-4510-8479-d1713ed92c1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cffec80-50b7-4b94-ae82-e8ec45c3bc27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:05 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Volume 0922f03e-931c-4e2c-b4b0-db067b01768f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0922f03e-931c-4e2c-b4b0-db067b01768f', 'volume_size': 1} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:05 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 1073741824" returned: 0 in 0.860s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:05 devstack sudo[107112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 Jul 06 21:31:05 devstack sudo[107112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Acquiring lock "cinder-d9e85dc4-05b1-4679-8327-746dd5aa5edf-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Lock "cinder-d9e85dc4-05b1-4679-8327-746dd5aa5edf-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Acquiring lock "cinder-quobyte-d9e85dc4-05b1-4679-8327-746dd5aa5edf" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Lock "cinder-quobyte-d9e85dc4-05b1-4679-8327-746dd5aa5edf" acquired by "delete_volume" :: waited 0.013s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a2c78e5-b8da-4250-ab50-42e77de37486]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:06 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf Jul 06 21:31:06 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:06 devstack sudo[107112]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92" returned: 0 in 0.659s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] <== create_volume: return (1555ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.557s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.601s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1b10f6e9-b15b-4213-a286-0eaba6ed3458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799fa804-58d4-4f47-aa68-86ead115a628) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot 05e38993-9229-4b87-aae8-848828f17edc of volume 6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:31:06 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Volume volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 (3e4fce34-3c35-4d7f-8ed2-151b55775f92): created successfully Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (799fa804-58d4-4f47-aa68-86ead115a628) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (065f68e4-3a7e-4f5f-bd5c-21075f0ff0b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7241ac2b-d94f-47a9-8b3d-777d94a59a0d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:06 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-be5cee3f-9721-4ecf-9b93-a6277ea6c5c1 tempest-ProjectReaderTests-1163838596 None] Created volume successfully. Jul 06 21:31:06 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c Jul 06 21:31:06 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:06 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf" returned: 0 in 0.788s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:06 devstack sudo[107122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf Jul 06 21:31:06 devstack sudo[107122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:07 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" returned: 0 in 0.766s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:07 devstack sudo[107127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc 1G Jul 06 21:31:07 devstack sudo[107127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:07 devstack sudo[107122]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d9e85dc4-05b1-4679-8327-746dd5aa5edf" returned: 0 in 0.664s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Lock "cinder-quobyte-d9e85dc4-05b1-4679-8327-746dd5aa5edf" released by "delete_volume" :: held 1.500s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Created reservations ['b9527c43-27b9-4296-beb5-1335759a0d27', 'ceb7e5bf-7c96-4999-aeb5-dfbd2c168eca', 'e5bee79d-2b78-40d5-a35e-08375cbd9852', '8d708429-5077-448e-9133-50508c96361e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:07 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:07 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:07 devstack sudo[107127]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc 1G" returned: 0 in 0.853s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:07 devstack sudo[107136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc Jul 06 21:31:07 devstack sudo[107136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:08 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.686s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Deleted volume successfully. Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-7f7f9872-57bd-4296-a6d6-541521fd426e tempest-ProjectReaderTests-1313226364 None] Lock "cinder-d9e85dc4-05b1-4679-8327-746dd5aa5edf-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Flow 'volume_create_manager' (3aee62cb-244c-4255-9a18-92944ee054f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad480a44-d8a6-4e0a-85ea-aca85c05de78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad480a44-d8a6-4e0a-85ea-aca85c05de78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167437139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7368a71eb13c44d0ad38a5801a31f690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:09Z,use_quota=True,user_id='cff6adde5f68458699ca706d75114e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1597d4-bf3e-4ba4-a1dc-a92c646e4dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b1597d4-bf3e-4ba4-a1dc-a92c646e4dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328e7e9d-b32d-47b2-91df-f22c76f8da31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:08 devstack sudo[107136]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (328e7e9d-b32d-47b2-91df-f22c76f8da31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5', 'volume_name': 'volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fc9c99-2feb-4ceb-97bd-833d825b5550) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a8fc9c99-2feb-4ceb-97bd-833d825b5550) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91e7bf7-3a30-41ed-a4de-d68fcb1f3451) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:08 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Volume dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5', 'volume_size': 1} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc" returned: 0 in 0.757s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:08 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc is being set with open permissions: ugo+rw Jul 06 21:31:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:08 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc Jul 06 21:31:08 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:09 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc" returned: 0 in 0.646s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:09 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.info Jul 06 21:31:09 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:09 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.info" returned: 0 in 0.644s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:09 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.info is being set with open permissions: ugo+rw Jul 06 21:31:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:10 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.info Jul 06 21:31:10 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:10 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.info" returned: 0 in 0.660s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.443s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.160s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1144061748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0922f03e-931c-4e2c-b4b0-db067b01768f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45a68f3593e4fb9910f033adfec61ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:05Z,use_quota=True,user_id='9a37e49f17f340cbb7ee1114fc8beb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Creating volume 0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:10 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:10 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f 1073741824 Jul 06 21:31:10 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:10 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0aafc4d3-91c4-4d73-b7f0-3940595c3152 tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-05e38993-9229-4b87-aae8-848828f17edc-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Lock "cinder-05e38993-9229-4b87-aae8-848828f17edc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-05e38993-9229-4b87-aae8-848828f17edc" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-05e38993-9229-4b87-aae8-848828f17edc" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot 05e38993-9229-4b87-aae8-848828f17edc of volume 6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e9b812a-cde3-4d23-8ffe-8d4893ccdecc]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:11 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc Jul 06 21:31:11 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:11 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f 1073741824" returned: 0 in 0.851s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:11 devstack sudo[107160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f Jul 06 21:31:11 devstack sudo[107160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:11 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc" returned: 0 in 0.824s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:31:11 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce9395f-e649-4ea6-918b-dd3860f8c282]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:11 devstack sudo[107165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c Jul 06 21:31:11 devstack sudo[107165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:12 devstack sudo[107160]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f" returned: 0 in 0.695s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.591s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 4.847s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0cffec80-50b7-4b94-ae82-e8ec45c3bc27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0922f03e-931c-4e2c-b4b0-db067b01768f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1e080c-bd3c-4693-8e43-8276b5b70563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Creating offline snapshot 2eae962f-33a7-42f6-9b45-5e975786cd83 of volume 3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:31:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Volume volume-0922f03e-931c-4e2c-b4b0-db067b01768f (0922f03e-931c-4e2c-b4b0-db067b01768f): created successfully Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb1e080c-bd3c-4693-8e43-8276b5b70563) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Flow 'volume_create_manager' (f8e1f804-a3f1-4ddd-ba69-327ab089d58c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c88c1de0-3567-4c1b-afdf-7c7548efcf1b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1964c66d-4906-4fe8-9f27-bf9573a8fe4d tempest-VolumeDependencyTests-2093714525 None] Created volume successfully. Jul 06 21:31:12 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 Jul 06 21:31:12 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:12 devstack sudo[107165]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" returned: 0 in 0.792s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:12 devstack sudo[107174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc Jul 06 21:31:12 devstack sudo[107174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:13 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92" returned: 0 in 0.857s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:13 devstack sudo[107179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 1G Jul 06 21:31:13 devstack sudo[107179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:13 devstack sudo[107174]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc" returned: 0 in 0.795s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:13 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc Jul 06 21:31:13 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:14 devstack sudo[107179]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 1G" returned: 0 in 0.834s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:14 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 Jul 06 21:31:14 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:14 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c.05e38993-9229-4b87-aae8-848828f17edc" returned: 0 in 0.684s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-05e38993-9229-4b87-aae8-848828f17edc" released by "_delete_snapshot" :: held 3.196s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" released by "delete_snapshot" :: held 3.222s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Created reservations ['160365bf-10e9-4ba0-a381-359d156d9a16', '32816a4a-f635-465c-84b2-72b9718111bd', '4021856f-1acf-489e-ac39-9dfeb81d1774', 'f709427b-2741-488b-a746-a8b34e6d3771'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-122aa9e2-22bc-4ce2-bcb0-cb9097f51e7d tempest-ProjectMemberTests-1942436667 None] Lock "cinder-05e38993-9229-4b87-aae8-848828f17edc-delete_snapshot" released by "delete_snapshot" :: held 3.350s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:14 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83" returned: 0 in 0.705s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:14 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 is being set with open permissions: ugo+rw Jul 06 21:31:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:14 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 Jul 06 21:31:14 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-6d7c3c72-e3e7-4d74-be92-2b690959ff4c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-6d7c3c72-e3e7-4d74-be92-2b690959ff4c-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[da6869b3-af2e-4bf9-aaa2-df7fa58d85bd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:15 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83" returned: 0 in 0.653s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:15 devstack sudo[107200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c Jul 06 21:31:15 devstack sudo[107200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:15 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.info Jul 06 21:31:15 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:16 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.info" returned: 0 in 0.651s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:16 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.info is being set with open permissions: ugo+rw Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:16 devstack sudo[107200]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" returned: 0 in 0.791s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:16 devstack sudo[107208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.info Jul 06 21:31:16 devstack sudo[107208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:16 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c Jul 06 21:31:16 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:16 devstack sudo[107208]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.info" returned: 0 in 0.628s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.436s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.042s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-167437139',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7368a71eb13c44d0ad38a5801a31f690',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:09Z,use_quota=True,user_id='cff6adde5f68458699ca706d75114e12',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Creating volume dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:16 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:16 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:16 devstack sudo[107214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 1073741824 Jul 06 21:31:16 devstack sudo[107214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" returned: 0 in 0.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:16 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f7c71fef-fcdb-47aa-9480-c3df24cdfe34 tempest-ProjectReaderTests-1163838596 None] Create snapshot completed successfully Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-6d7c3c72-e3e7-4d74-be92-2b690959ff4c" released by "delete_volume" :: held 1.522s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Created reservations ['753d6971-5bb0-4ea0-a84b-917b5dc16659', '7a9fc932-ccdf-4544-8fff-be1affcb9d0f', 'c27e6ef1-1ebd-4938-ac4b-335df3802ea7', '72248cd5-159e-499f-b631-f015c45fd207'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:16 devstack sudo[107216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:16 devstack sudo[107216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:17 devstack sudo[107216]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:31:17 devstack sudo[107214]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 1073741824" returned: 0 in 0.864s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-fda4eead-ea20-4b7b-8175-005e754cc8d9 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-6d7c3c72-e3e7-4d74-be92-2b690959ff4c-delete_volume" released by "delete_volume" :: held 2.402s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:17 devstack sudo[107222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 Jul 06 21:31:17 devstack sudo[107222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-2eae962f-33a7-42f6-9b45-5e975786cd83-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-2eae962f-33a7-42f6-9b45-5e975786cd83-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-3e4fce34-3c35-4d7f-8ed2-151b55775f92" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-3e4fce34-3c35-4d7f-8ed2-151b55775f92" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-2eae962f-33a7-42f6-9b45-5e975786cd83" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (5cdf83c9-e9b0-469c-bd30-ec396e0d9c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31386423-dd34-4316-bc79-c19f066911fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-2eae962f-33a7-42f6-9b45-5e975786cd83" acquired by "_delete_snapshot" :: waited 0.050s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Deleting offline snapshot 2eae962f-33a7-42f6-9b45-5e975786cd83 of volume 3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] snapshot_file for this snap is: volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (31386423-dd34-4316-bc79-c19f066911fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2065534472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48536e53-2363-41d3-a391-b821fb053672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:18Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:17 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a436c609-8416-40e6-8c3d-30e37f2c254b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a436c609-8416-40e6-8c3d-30e37f2c254b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001760bc-23ad-486b-befe-8624d9d74ef6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (001760bc-23ad-486b-befe-8624d9d74ef6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48536e53-2363-41d3-a391-b821fb053672', 'volume_name': 'volume-48536e53-2363-41d3-a391-b821fb053672', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d4acaf-300e-4ce4-8299-3d1989b8c070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31d4acaf-300e-4ce4-8299-3d1989b8c070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03691fd-b8d5-4ea1-8e99-267be9ace9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:18 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Volume 48536e53-2363-41d3-a391-b821fb053672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48536e53-2363-41d3-a391-b821fb053672', 'volume_size': 1} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6de4d56-6ce7-4151-84d3-010b71e45701]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:18 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 Jul 06 21:31:18 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:18 devstack sudo[107222]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5" returned: 0 in 0.716s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] <== create_volume: return (1626ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.630s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.264s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d91e7bf7-3a30-41ed-a4de-d68fcb1f3451) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fc8297-711e-4ed9-89d5-5b1355744d67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Creating offline snapshot 0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 of volume 0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:31:18 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Volume volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 (dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5): created successfully Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5fc8297-711e-4ed9-89d5-5b1355744d67) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Flow 'volume_create_manager' (3aee62cb-244c-4255-9a18-92944ee054f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a29c64ed-c368-4490-a3bf-0547d991a351]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:18 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-048a1c65-993d-43a9-9380-e9d64a2de787 tempest-ProjectReaderTests-1313226364 None] Created volume successfully. Jul 06 21:31:18 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f Jul 06 21:31:18 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:18 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83" returned: 0 in 0.790s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc1c60d5-ad74-4237-b30d-3e8262ffb9b4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:18 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 Jul 06 21:31:18 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:19 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Acquiring lock "cinder-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:19 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 1G Jul 06 21:31:19 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Lock "cinder-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Acquiring lock "cinder-quobyte-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Lock "cinder-quobyte-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6d1d5a6-a3f2-4589-abd9-43583885677b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:19 devstack sudo[107240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 Jul 06 21:31:19 devstack sudo[107240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:19 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92" returned: 0 in 0.789s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:19 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 Jul 06 21:31:19 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:20 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 1G" returned: 0 in 0.885s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0922f03e-931c-4e2c-b4b0-db067b01768f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:20 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0922f03e-931c-4e2c-b4b0-db067b01768f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 Jul 06 21:31:20 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:20 devstack sudo[107240]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5" returned: 0 in 0.796s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:20 devstack sudo[107257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5 Jul 06 21:31:20 devstack sudo[107257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:20 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83" returned: 0 in 0.784s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:20 devstack sudo[107262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83 Jul 06 21:31:20 devstack sudo[107262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:20 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0922f03e-931c-4e2c-b4b0-db067b01768f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:20 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 is being set with open permissions: ugo+rw Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:20 devstack sudo[107257]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:20 devstack sudo[107268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 Jul 06 21:31:20 devstack sudo[107268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Lock "cinder-quobyte-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5" released by "delete_volume" :: held 1.493s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Created reservations ['049dc6b9-85f8-443b-8ab5-4e280c8db1b2', 'f35d07b4-59b2-4e57-825e-dcf0663f32d9', '92f2864f-0fe5-4f5a-84bd-312e48d5d5ab', '7303ceef-d382-4ef8-8407-77e2f1a95678'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:20 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:20 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:21 devstack sudo[107262]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92.2eae962f-33a7-42f6-9b45-5e975786cd83" returned: 0 in 0.669s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-2eae962f-33a7-42f6-9b45-5e975786cd83" released by "_delete_snapshot" :: held 3.156s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-3e4fce34-3c35-4d7f-8ed2-151b55775f92" released by "delete_snapshot" :: held 3.213s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Created reservations ['ee5e339a-f417-4234-9b9e-599f43d6c523', 'aa7e70ff-0225-47ea-a98a-822483719eab', '50b52607-5688-47ff-b732-b74932a93156', 'b2e70ed1-66bc-4ff3-ba91-4f86d400f11e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Delete snapshot completed successfully. Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-bc27610b-da79-466f-88a2-af06b77d77d2 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-2eae962f-33a7-42f6-9b45-5e975786cd83-delete_snapshot" released by "delete_snapshot" :: held 3.351s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:21 devstack sudo[107268]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:21 devstack sudo[107274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.info Jul 06 21:31:21 devstack sudo[107274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:21 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.714s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Deleted volume successfully. Jul 06 21:31:21 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-03aa96f9-1b29-4754-90a3-47ff10061671 tempest-ProjectReaderTests-1313226364 None] Lock "cinder-dc6643cf-6bbf-45f5-8c3e-5afe1d59f6a5-delete_volume" released by "delete_volume" :: held 2.441s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-3e4fce34-3c35-4d7f-8ed2-151b55775f92-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:22 devstack sudo[107274]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.info" returned: 0 in 0.699s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:22 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.info is being set with open permissions: ugo+rw Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-3e4fce34-3c35-4d7f-8ed2-151b55775f92-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:22 devstack sudo[107278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.info Jul 06 21:31:22 devstack sudo[107278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-3e4fce34-3c35-4d7f-8ed2-151b55775f92" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-3e4fce34-3c35-4d7f-8ed2-151b55775f92" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd2b5f91-2df6-40b4-b33c-667814c4a3c3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:22 devstack sudo[107280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 Jul 06 21:31:22 devstack sudo[107280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:22 devstack sudo[107278]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.info" returned: 0 in 0.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.553s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.863s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2065534472',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48536e53-2363-41d3-a391-b821fb053672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:18Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Creating volume 48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:22 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:22 devstack sudo[107283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 1073741824 Jul 06 21:31:22 devstack sudo[107283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:22 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-664307c0-737e-4005-854b-e060fa341a62 tempest-VolumeDependencyTests-2093714525 None] Create snapshot completed successfully Jul 06 21:31:23 devstack sudo[107280]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92" returned: 0 in 0.873s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:23 devstack sudo[107288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92 Jul 06 21:31:23 devstack sudo[107288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:23 devstack sudo[107283]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 1073741824" returned: 0 in 0.950s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:23 devstack sudo[107288]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-3e4fce34-3c35-4d7f-8ed2-151b55775f92" returned: 0 in 0.751s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-3e4fce34-3c35-4d7f-8ed2-151b55775f92" released by "delete_volume" :: held 1.702s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:23 devstack sudo[107294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 Jul 06 21:31:23 devstack sudo[107294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Created reservations ['2a53392f-d592-4482-ae24-1403df1f8a5a', 'e6c6c194-c992-43dc-b9e2-04987e82dd4e', '6e727eb7-4807-4c37-a479-6373735ff142', 'a52392e6-1a36-4b23-8f25-b735a02d8c36'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Flow 'volume_create_manager' (0f3a7a62-ab99-4472-bac1-3a12c6aa0e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e5cc00-27dc-494b-bdd0-31d306e50c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d1e5cc00-27dc-494b-bdd0-31d306e50c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1028065294',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24edf791-ba12-470c-9064-69023f54d32c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c45a68f3593e4fb9910f033adfec61ec',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0cf6ca00-61a2-4f13-b116-c5c6e99cfea3,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:24Z,use_quota=True,user_id='9a37e49f17f340cbb7ee1114fc8beb37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519a8e13-1c53-4630-88ee-431d6eac213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (519a8e13-1c53-4630-88ee-431d6eac213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack sudo[107296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a429d95e-3ac2-443b-8be6-eb0ba511370a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack sudo[107296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a429d95e-3ac2-443b-8be6-eb0ba511370a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '24edf791-ba12-470c-9064-69023f54d32c', 'volume_name': 'volume-24edf791-ba12-470c-9064-69023f54d32c', 'volume_size': 1, 'snapshot_id': '0cf6ca00-61a2-4f13-b116-c5c6e99cfea3'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931d99b0-bc33-4d0b-a328-6c7527b6b647) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (931d99b0-bc33-4d0b-a328-6c7527b6b647) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1042c53a-ad5c-42ae-9bcc-a4399d70ac27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Volume 24edf791-ba12-470c-9064-69023f54d32c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-24edf791-ba12-470c-9064-69023f54d32c', 'volume_size': 1, 'snapshot_id': '0cf6ca00-61a2-4f13-b116-c5c6e99cfea3'} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:24 devstack sudo[107294]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672" returned: 0 in 0.686s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.385s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-quobyte-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3-24edf791-ba12-470c-9064-69023f54d32c" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a03691fd-b8d5-4ea1-8e99-267be9ace9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48536e53-2363-41d3-a391-b821fb053672', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb8ce81-fe9e-434e-8aa2-ded99cb2bf99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3-24edf791-ba12-470c-9064-69023f54d32c" acquired by "_create_volume_from_snapshot" :: waited 0.050s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Creating volume 24edf791-ba12-470c-9064-69023f54d32c from snapshot 0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-quobyte-24edf791-ba12-470c-9064-69023f54d32c" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:24 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Volume volume-48536e53-2363-41d3-a391-b821fb053672 (48536e53-2363-41d3-a391-b821fb053672): created successfully Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ddb8ce81-fe9e-434e-8aa2-ded99cb2bf99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (5cdf83c9-e9b0-469c-bd30-ec396e0d9c76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-24edf791-ba12-470c-9064-69023f54d32c" acquired by "_copy_volume_from_snapshot" :: waited 0.049s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] snapshot: 0cf6ca00-61a2-4f13-b116-c5c6e99cfea3, volume: 24edf791-ba12-470c-9064-69023f54d32c, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:31:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8ab0a64a-629c-4659-994d-b39fa864a29a tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2de4aa1-0cbd-4568-86a2-5b03b43f45da]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:24 devstack sudo[107296]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (6b7e41ab-1b51-4544-b639-caa27a9cc08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e757568-7ebb-4988-a4a7-a75d49c82851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e757568-7ebb-4988-a4a7-a75d49c82851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072893873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d0ef3d-e878-46ed-96cd-ee13fb6607cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:25Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ec2865-6cc3-4237-b471-f61e55175cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27ec2865-6cc3-4237-b471-f61e55175cf1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c170a1ed-76a1-4053-97bf-df784f1d7bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c170a1ed-76a1-4053-97bf-df784f1d7bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24d0ef3d-e878-46ed-96cd-ee13fb6607cf', 'volume_name': 'volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f753db9-826e-4233-94dd-fecaff2b828b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f753db9-826e-4233-94dd-fecaff2b828b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38c07e-2017-49c4-83c2-0882a85d0d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:24 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Volume 24d0ef3d-e878-46ed-96cd-ee13fb6607cf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf', 'volume_size': 1} Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Deleted volume successfully. Jul 06 21:31:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3db67b79-112c-4e8b-9124-fe2c2cb2b28f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-3e4fce34-3c35-4d7f-8ed2-151b55775f92-delete_volume" released by "delete_volume" :: held 2.788s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:25 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" returned: 0 in 0.783s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0922f03e-931c-4e2c-b4b0-db067b01768f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:31:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:31:25 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:31:25 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b66cb6d-155e-46ea-8534-e6c4c84eb719]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:25 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f Jul 06 21:31:25 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:26 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f" returned: 0 in 0.741s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:26 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:31:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:26 devstack sudo[107310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c Jul 06 21:31:26 devstack sudo[107310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:30 devstack sudo[107310]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c" returned: 0 in 4.497s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:30 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ea36a9f-e893-4347-a6ba-29ed3e46d88b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:30 devstack sudo[107324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f Jul 06 21:31:30 devstack sudo[107324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:31 devstack sudo[107324]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f" returned: 0 in 0.906s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:31 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f, size 1024.00 MB, duration 4.50 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:31:31 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Converted 1024.00 MB image at 227.67 MB/s Jul 06 21:31:31 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c is being set with open permissions: ugo+rw Jul 06 21:31:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:31 devstack sudo[107329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c Jul 06 21:31:31 devstack sudo[107329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:32 devstack sudo[107329]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c" returned: 0 in 0.626s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-24edf791-ba12-470c-9064-69023f54d32c" released by "_copy_volume_from_snapshot" :: held 7.663s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3-24edf791-ba12-470c-9064-69023f54d32c" released by "_create_volume_from_snapshot" :: held 7.727s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.778s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.446s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2072893873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24d0ef3d-e878-46ed-96cd-ee13fb6607cf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:25Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Creating volume 24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:32 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:32 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf 1073741824 Jul 06 21:31:32 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1042c53a-ad5c-42ae-9bcc-a4399d70ac27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24edf791-ba12-470c-9064-69023f54d32c', 'volume_size': 1, 'snapshot_id': '0cf6ca00-61a2-4f13-b116-c5c6e99cfea3'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4943eaee-323f-49c5-ba9d-2c74c2204f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:32 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Volume volume-24edf791-ba12-470c-9064-69023f54d32c (24edf791-ba12-470c-9064-69023f54d32c): created successfully Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4943eaee-323f-49c5-ba9d-2c74c2204f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Flow 'volume_create_manager' (0f3a7a62-ab99-4472-bac1-3a12c6aa0e19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1adfd979-be2f-4838-bfe2-30127480537d tempest-VolumeDependencyTests-2093714525 None] Created volume successfully. Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-quobyte-0922f03e-931c-4e2c-b4b0-db067b01768f" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0922f03e-931c-4e2c-b4b0-db067b01768f" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-quobyte-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Deleting offline snapshot 0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 of volume 0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] snapshot_file for this snap is: volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd51d1fa-df74-46a6-b636-928587772766]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:32 devstack sudo[107334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 Jul 06 21:31:32 devstack sudo[107334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:33 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf 1073741824" returned: 0 in 0.824s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:33 devstack sudo[107340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf Jul 06 21:31:33 devstack sudo[107340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:33 devstack sudo[107334]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" returned: 0 in 0.772s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0922f03e-931c-4e2c-b4b0-db067b01768f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[20b7f544-9043-48e2-bf0a-a202f8464e5c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:33 devstack sudo[107345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f Jul 06 21:31:33 devstack sudo[107345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:33 devstack sudo[107340]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" returned: 0 in 0.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] <== create_volume: return (1537ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.457s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot 49ab66dd-25c2-4604-810f-d9636ea97217 of volume 48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a38c07e-2017-49c4-83c2-0882a85d0d37) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1146b6-c445-48d7-8a72-4fd605d5ddb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[800ca297-8da8-4634-8abf-8b63f6e7d9a5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:33 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Volume volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf (24d0ef3d-e878-46ed-96cd-ee13fb6607cf): created successfully Jul 06 21:31:33 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5d1146b6-c445-48d7-8a72-4fd605d5ddb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (6b7e41ab-1b51-4544-b639-caa27a9cc08a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-944c2eb8-a515-4917-9313-79c714073747 tempest-ProjectReaderTests-1163838596 None] Created volume successfully. Jul 06 21:31:34 devstack sudo[107348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 Jul 06 21:31:34 devstack sudo[107348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:34 devstack sudo[107345]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f" returned: 0 in 0.743s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:34 devstack sudo[107353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 Jul 06 21:31:34 devstack sudo[107353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:34 devstack sudo[107348]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672" returned: 0 in 0.812s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:34 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 1G Jul 06 21:31:34 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:35 devstack sudo[107353]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" returned: 0 in 0.731s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:35 devstack sudo[107363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3 Jul 06 21:31:35 devstack sudo[107363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:35 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 1G" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48536e53-2363-41d3-a391-b821fb053672 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:35 devstack sudo[107368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48536e53-2363-41d3-a391-b821fb053672 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 Jul 06 21:31:35 devstack sudo[107368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:35 devstack sudo[107363]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f.0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" returned: 0 in 0.651s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3" released by "_delete_snapshot" :: held 2.999s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0922f03e-931c-4e2c-b4b0-db067b01768f" released by "delete_snapshot" :: held 3.025s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Created reservations ['b9a531d0-d71d-43a2-8e3e-f7618f3cae79', 'a78b694e-844f-4b64-a250-0a5f291fa6c4', '741867b9-edcc-442b-bd04-9357142360d8', '517fcd35-599f-4a92-8b38-0fbaa0e29727'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Delete snapshot completed successfully. Jul 06 21:31:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-213880c2-af7c-4aef-9a24-2c2ceaac2ee9 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-0cf6ca00-61a2-4f13-b116-c5c6e99cfea3-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:36 devstack sudo[107368]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-48536e53-2363-41d3-a391-b821fb053672 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217" returned: 0 in 0.704s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:36 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 is being set with open permissions: ugo+rw Jul 06 21:31:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:36 devstack sudo[107374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 Jul 06 21:31:36 devstack sudo[107374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:36 devstack sudo[107374]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217" returned: 0 in 0.624s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:36 devstack sudo[107377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.info Jul 06 21:31:36 devstack sudo[107377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-0922f03e-931c-4e2c-b4b0-db067b01768f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-0922f03e-931c-4e2c-b4b0-db067b01768f-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-quobyte-0922f03e-931c-4e2c-b4b0-db067b01768f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0922f03e-931c-4e2c-b4b0-db067b01768f" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d69862f-7bc9-4268-827f-c453d1e2a701]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:37 devstack sudo[107379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f Jul 06 21:31:37 devstack sudo[107379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:37 devstack sudo[107377]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.info" returned: 0 in 0.665s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:37 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.info is being set with open permissions: ugo+rw Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:37 devstack sudo[107382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.info Jul 06 21:31:37 devstack sudo[107382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:37 devstack sudo[107379]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f" returned: 0 in 0.765s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:37 devstack sudo[107387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f Jul 06 21:31:37 devstack sudo[107387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:38 devstack sudo[107382]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.info" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.350s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.618s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Creating offline snapshot 6d997b89-ae1b-41b3-bd96-e1159d25902c of volume 24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:31:38 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5795e3b6-baba-4e89-b6a9-d941e9abf973 tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[972bfb89-8d61-463d-882a-4fa405534840]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:38 devstack sudo[107390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf Jul 06 21:31:38 devstack sudo[107390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:38 devstack sudo[107387]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-0922f03e-931c-4e2c-b4b0-db067b01768f" returned: 0 in 0.662s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-0922f03e-931c-4e2c-b4b0-db067b01768f" released by "delete_volume" :: held 1.483s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Created reservations ['2b189c6c-db0f-4689-8d3d-dba66b6ba48a', 'bdeb1177-3c2e-490f-8782-1320f4bc3c96', '00d3f8d3-f544-4008-a0b2-c1a0dd197a59', 'f5cb2c0b-4522-479e-b7b8-4d50cb493f2f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:38 devstack sudo[107393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:38 devstack sudo[107393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-49ab66dd-25c2-4604-810f-d9636ea97217-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-49ab66dd-25c2-4604-810f-d9636ea97217-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-48536e53-2363-41d3-a391-b821fb053672" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-48536e53-2363-41d3-a391-b821fb053672" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-49ab66dd-25c2-4604-810f-d9636ea97217" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-49ab66dd-25c2-4604-810f-d9636ea97217" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:39 devstack sudo[107390]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot 49ab66dd-25c2-4604-810f-d9636ea97217 of volume 48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" returned: 0 in 0.838s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c039ea3b-a1ef-4c82-a1f2-ef3bd4daa102]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:39 devstack sudo[107400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c 1G Jul 06 21:31:39 devstack sudo[107400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-24edf791-ba12-470c-9064-69023f54d32c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-24edf791-ba12-470c-9064-69023f54d32c-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "cinder-quobyte-24edf791-ba12-470c-9064-69023f54d32c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:39 devstack sudo[107401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 Jul 06 21:31:39 devstack sudo[107401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-24edf791-ba12-470c-9064-69023f54d32c" acquired by "delete_volume" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c910b687-e2c0-4f8b-ad91-d4cb428b8fea]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:39 devstack sudo[107393]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.760s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Deleted volume successfully. Jul 06 21:31:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-69a1f338-0a5f-40b9-8a05-49188857d3f4 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-0922f03e-931c-4e2c-b4b0-db067b01768f-delete_volume" released by "delete_volume" :: held 2.452s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:39 devstack sudo[107405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c Jul 06 21:31:39 devstack sudo[107405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:40 devstack sudo[107401]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217" returned: 0 in 0.844s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-48536e53-2363-41d3-a391-b821fb053672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:31:40 devstack sudo[107400]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c 1G" returned: 0 in 0.882s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2455d59-914d-4497-a66d-ab45faab333a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:40 devstack sudo[107416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c Jul 06 21:31:40 devstack sudo[107416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:40 devstack sudo[107417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 Jul 06 21:31:40 devstack sudo[107417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:40 devstack sudo[107405]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c" returned: 0 in 0.821s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:40 devstack sudo[107421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c Jul 06 21:31:40 devstack sudo[107421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:40 devstack sudo[107416]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c" returned: 0 in 0.724s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:40 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c is being set with open permissions: ugo+rw Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:40 devstack sudo[107430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c Jul 06 21:31:40 devstack sudo[107430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:40 devstack sudo[107421]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24edf791-ba12-470c-9064-69023f54d32c" returned: 0 in 0.649s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-quobyte-24edf791-ba12-470c-9064-69023f54d32c" released by "delete_volume" :: held 1.512s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:40 devstack sudo[107417]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:40 devstack sudo[107432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 Jul 06 21:31:40 devstack sudo[107432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Created reservations ['0b97415a-20d0-4fa4-9e69-b8f6f3c10b2b', '7e03d8f7-f7d0-4444-a44c-0ddf50108b3f', '228906d9-8f41-41d5-b2d2-9884a3a53d9e', '649e5065-d526-41c7-b7da-884b94d58d42'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:41 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:41 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:41 devstack sudo[107430]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c" returned: 0 in 0.644s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:41 devstack sudo[107440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.info Jul 06 21:31:41 devstack sudo[107440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:41 devstack sudo[107432]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217" returned: 0 in 0.769s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:41 devstack sudo[107444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217 Jul 06 21:31:41 devstack sudo[107444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:41 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:41 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Deleted volume successfully. Jul 06 21:31:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-80744d45-783e-4368-811b-234b68437af0 tempest-VolumeDependencyTests-2093714525 None] Lock "cinder-24edf791-ba12-470c-9064-69023f54d32c-delete_volume" released by "delete_volume" :: held 2.449s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:42 devstack sudo[107440]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.info" returned: 0 in 0.715s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:42 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.info is being set with open permissions: ugo+rw Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:42 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.info Jul 06 21:31:42 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:42 devstack sudo[107444]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672.49ab66dd-25c2-4604-810f-d9636ea97217" returned: 0 in 0.672s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-49ab66dd-25c2-4604-810f-d9636ea97217" released by "_delete_snapshot" :: held 3.267s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-48536e53-2363-41d3-a391-b821fb053672" released by "delete_snapshot" :: held 3.297s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Created reservations ['fccbdced-d7ee-412b-a095-5f9287271a55', 'cb1c0461-f8c3-4bda-a740-2c0529f7b469', '3ce99ac4-aff1-472d-82d6-5f62ce8ae1f5', 'e21c91ce-8075-44d1-bf06-da6ab888c851'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-129a42f2-31ad-4f39-bba5-bcd5c0c5e10a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-49ab66dd-25c2-4604-810f-d9636ea97217-delete_snapshot" released by "delete_snapshot" :: held 3.452s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:42 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.info" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.596s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:42 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-343b31f4-12d8-428b-85a7-efdd92596837 tempest-ProjectReaderTests-1163838596 None] Create snapshot completed successfully Jul 06 21:31:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-48536e53-2363-41d3-a391-b821fb053672-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-48536e53-2363-41d3-a391-b821fb053672-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-48536e53-2363-41d3-a391-b821fb053672" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:43 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-48536e53-2363-41d3-a391-b821fb053672" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:43 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[06c38f60-15e0-49a6-b1a8-8631c53bf92c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:43 devstack sudo[107451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 Jul 06 21:31:43 devstack sudo[107451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-6d997b89-ae1b-41b3-bd96-e1159d25902c-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Lock "cinder-6d997b89-ae1b-41b3-bd96-e1159d25902c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-6d997b89-ae1b-41b3-bd96-e1159d25902c" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-6d997b89-ae1b-41b3-bd96-e1159d25902c" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Deleting offline snapshot 6d997b89-ae1b-41b3-bd96-e1159d25902c of volume 24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] snapshot_file for this snap is: volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5dff3d0-8319-42f9-b499-c4b1ee962a05]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:44 devstack sudo[107456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c Jul 06 21:31:44 devstack sudo[107456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:44 devstack sudo[107451]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672" returned: 0 in 0.825s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:44 devstack sudo[107459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672 Jul 06 21:31:44 devstack sudo[107459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Flow 'volume_create_manager' (ac2052fa-bfc4-4893-9dd1-f174633f44e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dcf28a-96a8-442c-b1bb-419687cbde87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47dcf28a-96a8-442c-b1bb-419687cbde87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13429a19-7c06-4073-93e4-682a976a9e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3235afb6c94753acba73de0abca022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:45Z,use_quota=True,user_id='787e3ab8f7bf400abfc81852fc423991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b47f0a-ce4f-41e4-b0d2-1486555e2f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93b47f0a-ce4f-41e4-b0d2-1486555e2f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe5ffe8-5494-4db8-8be3-067017804b7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfe5ffe8-5494-4db8-8be3-067017804b7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13429a19-7c06-4073-93e4-682a976a9e9d', 'volume_name': 'volume-13429a19-7c06-4073-93e4-682a976a9e9d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713565f9-77d9-42dc-9715-b4671d64d11d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (713565f9-77d9-42dc-9715-b4671d64d11d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f07f727-8441-4868-8f16-f2d5fadc13a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:44 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Volume 13429a19-7c06-4073-93e4-682a976a9e9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13429a19-7c06-4073-93e4-682a976a9e9d', 'volume_size': 1} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:44Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13429a19-7c06-4073-93e4-682a976a9e9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3235afb6c94753acba73de0abca022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:45Z,use_quota=True,user_id='787e3ab8f7bf400abfc81852fc423991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Creating volume 13429a19-7c06-4073-93e4-682a976a9e9d {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:44 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:44 devstack sudo[107461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d 1073741824 Jul 06 21:31:44 devstack sudo[107461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:45 devstack sudo[107456]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:45 devstack sudo[107459]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c" returned: 0 in 0.860s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-48536e53-2363-41d3-a391-b821fb053672" returned: 0 in 0.745s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dbbe50f-d2c5-4b07-b455-a20b3e078753]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-48536e53-2363-41d3-a391-b821fb053672" released by "delete_volume" :: held 1.646s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Created reservations ['ad201939-1586-4c67-a2ef-7b9ea4b8ba7c', '6600b5eb-6a47-450e-9a73-202bccc27270', '1ed63ca6-83ab-4ba2-a6d7-18ba6a7e9670', 'e813e5cb-d12f-40f7-8a36-ba2a84faa8ae'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:45 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf Jul 06 21:31:45 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:45 devstack sudo[107470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:45 devstack sudo[107470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:45 devstack sudo[107461]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d 1073741824" returned: 0 in 0.869s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:45 devstack sudo[107475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d Jul 06 21:31:45 devstack sudo[107475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:45 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" returned: 0 in 0.923s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:46 devstack sudo[107470]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:46 devstack sudo[107481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c Jul 06 21:31:46 devstack sudo[107481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.853s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-b894fcba-473e-405a-8bd3-27482d8d4cb8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-48536e53-2363-41d3-a391-b821fb053672-delete_volume" released by "delete_volume" :: held 2.712s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (61e4993f-5940-436d-90b1-d61d7f7a6942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ba8f56-2023-4836-a8c6-754a09a728be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ba8f56-2023-4836-a8c6-754a09a728be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821277506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44856b3-46bf-4266-80b2-77860ede3de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:46Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e84da9-ba09-4ad9-a4f8-c7071e6ac810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87e84da9-ba09-4ad9-a4f8-c7071e6ac810) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eb51a0-fe39-42b0-8cf1-711cf708842d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05eb51a0-fe39-42b0-8cf1-711cf708842d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd44856b3-46bf-4266-80b2-77860ede3de7', 'volume_name': 'volume-d44856b3-46bf-4266-80b2-77860ede3de7', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1685c443-f9c5-4b80-a475-647dd6ae28c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1685c443-f9c5-4b80-a475-647dd6ae28c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69663f02-3008-433f-a2cb-bc041e950bae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:46 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Volume d44856b3-46bf-4266-80b2-77860ede3de7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d44856b3-46bf-4266-80b2-77860ede3de7', 'volume_size': 1} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:46 devstack sudo[107475]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d" returned: 0 in 0.751s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] <== create_volume: return (1693ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.697s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.102s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-821277506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d44856b3-46bf-4266-80b2-77860ede3de7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:46Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Creating volume d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:46 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f07f727-8441-4868-8f16-f2d5fadc13a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13429a19-7c06-4073-93e4-682a976a9e9d', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:46 devstack sudo[107484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 1073741824 Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9804d979-95ca-4b33-a827-6961f9d64f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:46 devstack sudo[107484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:46 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Volume volume-13429a19-7c06-4073-93e4-682a976a9e9d (13429a19-7c06-4073-93e4-682a976a9e9d): created successfully Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9804d979-95ca-4b33-a827-6961f9d64f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Flow 'volume_create_manager' (ac2052fa-bfc4-4893-9dd1-f174633f44e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:46 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d9850b86-5466-4de3-aedf-24e6c3fcad7b tempest-CinderUnicodeTest-214790734 None] Created volume successfully. Jul 06 21:31:46 devstack sudo[107481]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c" returned: 0 in 0.818s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:46 devstack sudo[107489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c Jul 06 21:31:46 devstack sudo[107489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:47 devstack sudo[107484]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 1073741824" returned: 0 in 0.910s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Flow 'volume_create_manager' (539f44a0-51e1-45b9-b258-e6752406dd43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ed8d56-1534-4fb5-bbe6-47afb7d061c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58ed8d56-1534-4fb5-bbe6-47afb7d061c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-981242280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7785f1-3dea-48c7-8ee4-3d42274d6e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3235afb6c94753acba73de0abca022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:47Z,use_quota=True,user_id='787e3ab8f7bf400abfc81852fc423991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52d6452-cc9f-4bae-ae4b-58370aa2f69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a52d6452-cc9f-4bae-ae4b-58370aa2f69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e1e0b4-cb7a-4bf1-8b43-c18331c5292b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9e1e0b4-cb7a-4bf1-8b43-c18331c5292b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb7785f1-3dea-48c7-8ee4-3d42274d6e4c', 'volume_name': 'volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986ac641-53c8-4c3c-9bdb-ea6487072605) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (986ac641-53c8-4c3c-9bdb-ea6487072605) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0ba194-f9bc-4aa5-b942-bc584ea7a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:47 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Volume eb7785f1-3dea-48c7-8ee4-3d42274d6e4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c', 'volume_size': 1} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:47 devstack sudo[107496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 Jul 06 21:31:47 devstack sudo[107496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:47 devstack sudo[107489]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf.6d997b89-ae1b-41b3-bd96-e1159d25902c" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-6d997b89-ae1b-41b3-bd96-e1159d25902c" released by "_delete_snapshot" :: held 3.405s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" released by "delete_snapshot" :: held 3.428s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Created reservations ['96b7bf20-15b0-458a-8cff-f027140af608', 'd1051a0a-aa18-4f3d-b4c1-111ec019e98a', 'f9df259a-2ad0-4a4a-8796-22eac1ed3524', '8425da05-3423-4960-b547-6778c4ff3f7a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:47 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Delete snapshot completed successfully. Jul 06 21:31:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-eaaa00b2-d4c7-4b8e-9a68-714f905fd8ed tempest-ProjectReaderTests-1163838596 None] Lock "cinder-6d997b89-ae1b-41b3-bd96-e1159d25902c-delete_snapshot" released by "delete_snapshot" :: held 3.574s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:48 devstack sudo[107496]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7" returned: 0 in 0.653s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.725s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.661s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:47Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-981242280',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb7785f1-3dea-48c7-8ee4-3d42274d6e4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bd3235afb6c94753acba73de0abca022',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:47Z,use_quota=True,user_id='787e3ab8f7bf400abfc81852fc423991',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Creating volume eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:48 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:48 devstack sudo[107499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c 1073741824 Jul 06 21:31:48 devstack sudo[107499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69663f02-3008-433f-a2cb-bc041e950bae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d44856b3-46bf-4266-80b2-77860ede3de7', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18da70c6-e3b4-412d-93d3-04716ce4d64f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:48 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Volume volume-d44856b3-46bf-4266-80b2-77860ede3de7 (d44856b3-46bf-4266-80b2-77860ede3de7): created successfully Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18da70c6-e3b4-412d-93d3-04716ce4d64f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (61e4993f-5940-436d-90b1-d61d7f7a6942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:48 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-5a9a9a12-ea3b-491c-88ad-4989a9b28346 tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-24d0ef3d-e878-46ed-96cd-ee13fb6607cf-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-24d0ef3d-e878-46ed-96cd-ee13fb6607cf-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[37d18c82-66a4-4883-8f01-2d74d42e1c46]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:48 devstack sudo[107501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf Jul 06 21:31:48 devstack sudo[107501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:48 devstack sudo[107499]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c 1073741824" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:49 devstack sudo[107506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c Jul 06 21:31:49 devstack sudo[107506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:49 devstack sudo[107501]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:49 devstack sudo[107512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf Jul 06 21:31:49 devstack sudo[107512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:49 devstack sudo[107506]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" returned: 0 in 0.695s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] <== create_volume: return (1568ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.573s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.141s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot 66735927-5bee-4a93-bd11-eeb39d082156 of volume d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5a0ba194-f9bc-4aa5-b942-bc584ea7a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530361d2-c28b-41a3-b1ef-4807c3c442e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b91a302f-d62b-4e92-986f-3c51222d4b64]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Volume volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c (eb7785f1-3dea-48c7-8ee4-3d42274d6e4c): created successfully Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (530361d2-c28b-41a3-b1ef-4807c3c442e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Flow 'volume_create_manager' (539f44a0-51e1-45b9-b258-e6752406dd43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1abcee27-acff-4081-b3ef-167cd0f8a885 tempest-CinderUnicodeTest-214790734 None] Created volume successfully. Jul 06 21:31:49 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 Jul 06 21:31:49 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:49 devstack sudo[107512]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" returned: 0 in 0.702s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-24d0ef3d-e878-46ed-96cd-ee13fb6607cf" released by "delete_volume" :: held 1.542s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:49 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Created reservations ['5e008ad9-88ee-4d36-b7fd-bd1e2feb6975', '80ddbf08-f8d2-4a44-93ce-e42388542d3b', 'dad231e6-bdac-4ec5-846c-d81816ae5c3b', '1e379088-4a98-4378-a6f6-b26590d29201'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:50 devstack sudo[107518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:31:50 devstack sudo[107518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:50 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7" returned: 0 in 0.781s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:50 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 1G Jul 06 21:31:50 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:50 devstack sudo[107518]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.735s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:31:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Deleted volume successfully. Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-aaf1b1af-4937-4d25-8881-f6a15e83433f tempest-ProjectReaderTests-1163838596 None] Lock "cinder-24d0ef3d-e878-46ed-96cd-ee13fb6607cf-delete_volume" released by "delete_volume" :: held 2.507s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (9ac7a64a-eb20-4faa-9311-eeb6158634b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c2200f-e836-479e-a815-e2d8254ee8c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2c2200f-e836-479e-a815-e2d8254ee8c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245262576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:51Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d1e88-cd80-4d5b-9f2e-45d55ff07407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (467d1e88-cd80-4d5b-9f2e-45d55ff07407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f29703c-6bd0-47e4-bbd6-5c300300946a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6f29703c-6bd0-47e4-bbd6-5c300300946a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e', 'volume_name': 'volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d943dd-6599-424c-a0aa-f53207b89c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62d943dd-6599-424c-a0aa-f53207b89c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95724d86-9f68-4f7b-b656-2463ae53c025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:31:51 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Volume 21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e', 'volume_size': 1} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:51 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 1G" returned: 0 in 0.914s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44856b3-46bf-4266-80b2-77860ede3de7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:51 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44856b3-46bf-4266-80b2-77860ede3de7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 Jul 06 21:31:51 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:52 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d44856b3-46bf-4266-80b2-77860ede3de7 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:52 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 is being set with open permissions: ugo+rw Jul 06 21:31:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:52 devstack sudo[107534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 Jul 06 21:31:52 devstack sudo[107534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:52 devstack sudo[107534]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156" returned: 0 in 0.643s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:52 devstack sudo[107537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.info Jul 06 21:31:52 devstack sudo[107537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:53 devstack sudo[107537]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.info" returned: 0 in 0.648s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:53 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.info is being set with open permissions: ugo+rw Jul 06 21:31:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:53 devstack sudo[107554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.info Jul 06 21:31:53 devstack sudo[107554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:54 devstack sudo[107554]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.info" returned: 0 in 0.653s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.430s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.260s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Creating offline snapshot 0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 of volume eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1a65632-93ec-44e6-bd37-80add1446e43]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:54 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d5bfdc89-491a-4fb3-a9d4-99dac199296a tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:31:54 devstack sudo[107579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c Jul 06 21:31:54 devstack sudo[107579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:54 devstack sudo[107579]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" returned: 0 in 0.741s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:54 devstack sudo[107584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 1G Jul 06 21:31:54 devstack sudo[107584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:54 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-66735927-5bee-4a93-bd11-eeb39d082156-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-66735927-5bee-4a93-bd11-eeb39d082156-delete_snapshot" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-d44856b3-46bf-4266-80b2-77860ede3de7" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-d44856b3-46bf-4266-80b2-77860ede3de7" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-66735927-5bee-4a93-bd11-eeb39d082156" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-66735927-5bee-4a93-bd11-eeb39d082156" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot 66735927-5bee-4a93-bd11-eeb39d082156 of volume d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24585e5-fa29-4932-9883-8f7a762f2d5a]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:55 devstack sudo[107586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 Jul 06 21:31:55 devstack sudo[107586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:55 devstack sudo[107584]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 1G" returned: 0 in 0.803s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:55 devstack sudo[107591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 Jul 06 21:31:55 devstack sudo[107591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:55 devstack sudo[107586]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156" returned: 0 in 0.759s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d44856b3-46bf-4266-80b2-77860ede3de7(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98945ab-2aea-4d4b-b988-7fa0adf16ca6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:55 devstack sudo[107596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 Jul 06 21:31:55 devstack sudo[107596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:56 devstack sudo[107591]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" returned: 0 in 0.724s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:56 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 is being set with open permissions: ugo+rw Jul 06 21:31:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:56 devstack sudo[107602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 Jul 06 21:31:56 devstack sudo[107602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:56 devstack sudo[107596]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7" returned: 0 in 0.814s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:56 devstack sudo[107607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 Jul 06 21:31:56 devstack sudo[107607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:57 devstack sudo[107602]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" returned: 0 in 0.658s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:57 devstack sudo[107610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.info Jul 06 21:31:57 devstack sudo[107610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:57 devstack sudo[107607]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156" returned: 0 in 0.760s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:57 devstack sudo[107622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156 Jul 06 21:31:57 devstack sudo[107622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:57 devstack sudo[107610]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.info" returned: 0 in 0.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:57 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.info is being set with open permissions: ugo+rw Jul 06 21:31:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:57 devstack sudo[107625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.info Jul 06 21:31:57 devstack sudo[107625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:58 devstack sudo[107622]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7.66735927-5bee-4a93-bd11-eeb39d082156" returned: 0 in 0.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-66735927-5bee-4a93-bd11-eeb39d082156" released by "_delete_snapshot" :: held 3.098s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-d44856b3-46bf-4266-80b2-77860ede3de7" released by "delete_snapshot" :: held 3.126s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Created reservations ['f493991f-e623-4f69-a0c9-0401daeead55', '7aaf081e-7f53-4470-b4a2-dd38293073db', '5233e56f-f7be-4870-a309-7504f6971599', 'f854939d-aaaa-45eb-a979-6a1ec13886b9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:31:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4d2b2a01-b599-4a22-adbd-40926bdddbf6 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-66735927-5bee-4a93-bd11-eeb39d082156-delete_snapshot" released by "delete_snapshot" :: held 3.253s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:31:58 devstack sudo[107625]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.info" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.352s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.334s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-245262576',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:31:51Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Creating volume 21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:31:58 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=132,cinder:INSERT=52,cinder:UPDATE=167,cinder:DELETE=10 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:31:58 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e 1073741824 Jul 06 21:31:58 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:58 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=135,cinder:INSERT=37,cinder:UPDATE=168,cinder:DELETE=17 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:31:58 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-0fb8eff1-f71a-49e3-aadc-9749ee455ad2 tempest-CinderUnicodeTest-214790734 None] Create snapshot completed successfully Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "cinder-0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "cinder-quobyte-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "cinder-quobyte-0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-d44856b3-46bf-4266-80b2-77860ede3de7-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-d44856b3-46bf-4266-80b2-77860ede3de7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Deleting offline snapshot 0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 of volume eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] snapshot_file for this snap is: volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[639dace4-7def-42bf-85c7-a072bb09e0de]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-d44856b3-46bf-4266-80b2-77860ede3de7" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-d44856b3-46bf-4266-80b2-77860ede3de7" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:31:59 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e 1073741824" returned: 0 in 0.933s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[45a2aea4-d02d-4a9a-b30d-96c537f33832]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:59 devstack sudo[107638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 Jul 06 21:31:59 devstack sudo[107638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:31:59 devstack sudo[107641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e Jul 06 21:31:59 devstack sudo[107641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:31:59 devstack sudo[107639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 Jul 06 21:31:59 devstack sudo[107639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:00 devstack sudo[107638]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:32:00 devstack sudo[107641]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" returned: 0 in 0.687s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] <== create_volume: return (1674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.677s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[5003d216-4daa-4cf4-b094-cb8081561510]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (95724d86-9f68-4f7b-b656-2463ae53c025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57667be3-50f0-4cbd-b813-133235ded32d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:00 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Volume volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e (21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e): created successfully Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57667be3-50f0-4cbd-b813-133235ded32d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (9ac7a64a-eb20-4faa-9311-eeb6158634b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ffbaaaac-405d-4a42-9789-12d609d6cb8d tempest-ProjectReaderTests-1163838596 None] Created volume successfully. Jul 06 21:32:00 devstack sudo[107639]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7" returned: 0 in 0.841s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:00 devstack sudo[107654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c Jul 06 21:32:00 devstack sudo[107654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:00 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7 Jul 06 21:32:00 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Creating offline snapshot 9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 of volume 21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[44445ffc-5b52-4e5b-9992-444013b3c91b]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:00 devstack sudo[107658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e Jul 06 21:32:00 devstack sudo[107658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:00 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-d44856b3-46bf-4266-80b2-77860ede3de7" returned: 0 in 0.681s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:00 devstack sudo[107654]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-d44856b3-46bf-4266-80b2-77860ede3de7" released by "delete_volume" :: held 1.592s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" returned: 0 in 0.821s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:01 devstack sudo[107664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 Jul 06 21:32:01 devstack sudo[107664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Created reservations ['a784158b-0897-49b4-8de4-d6a7d184cf0a', '486550b6-22fc-4687-a4a1-31487747371e', 'fc8e17c1-113e-4c39-b59d-3b990f28f94b', '63487541-d701-4d6a-a24e-e94cd356ef0f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:01 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:01 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:01 devstack sudo[107668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:01 devstack sudo[107668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:01 devstack sudo[107658]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" returned: 0 in 0.921s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:01 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 1G Jul 06 21:32:01 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:01 devstack sudo[107664]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" returned: 0 in 0.955s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:01 devstack sudo[107680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4 Jul 06 21:32:01 devstack sudo[107680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:02 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (f1437eca-b911-4119-8019-07a9b53e80cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf45ca7-d73e-45d0-9886-471bbf62ea81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:02 devstack sudo[107668]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.070s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 1.023s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf45ca7-d73e-45d0-9886-471bbf62ea81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242593207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be8c66d-fb22-4b53-b057-1a8007c36138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:02Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f01131-8312-4747-88d8-30427dc0abcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f01131-8312-4747-88d8-30427dc0abcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d02915-cc79-42f7-97c7-f18fb65cbd0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d02915-cc79-42f7-97c7-f18fb65cbd0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9be8c66d-fb22-4b53-b057-1a8007c36138', 'volume_name': 'volume-9be8c66d-fb22-4b53-b057-1a8007c36138', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a773b8c-9737-4234-91c9-f327a6fa4299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a773b8c-9737-4234-91c9-f327a6fa4299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f3386e-d457-4421-a15f-50d85d1acd28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:02 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Volume 9be8c66d-fb22-4b53-b057-1a8007c36138: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9be8c66d-fb22-4b53-b057-1a8007c36138', 'volume_size': 1} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-4b9e52f4-74d6-4774-8901-fcf79f704805 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-d44856b3-46bf-4266-80b2-77860ede3de7-delete_volume" released by "delete_volume" :: held 2.982s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 29 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:32:02 devstack sudo[107680]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c.0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" returned: 0 in 0.738s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:02 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 1G" returned: 0 in 0.986s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4" released by "_delete_snapshot" :: held 3.445s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" released by "delete_snapshot" :: held 3.491s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:02 devstack sudo[107687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 Jul 06 21:32:02 devstack sudo[107687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Created reservations ['fd693623-84b8-440c-8346-b8d7a6ae1b7b', 'c99d4de1-175c-4442-bb26-0621541c99a7', '3ba7f5b4-8020-42d6-970d-1ea3d4a42b97', '5990dd04-df81-478b-931e-1563c9170fe9'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Delete snapshot completed successfully. Jul 06 21:32:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a72b0d1c-f2fa-41b7-8d2e-d383446cc8d3 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-0e5309bf-d3f3-4aa7-8c8a-e7eed54789c4-delete_snapshot" released by "delete_snapshot" :: held 3.643s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:03 devstack sudo[107687]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" returned: 0 in 0.693s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:03 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 is being set with open permissions: ugo+rw Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:03 devstack sudo[107692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 Jul 06 21:32:03 devstack sudo[107692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Acquiring lock "cinder-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Lock "cinder-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Acquiring lock "cinder-quobyte-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6dbe6ef-b40e-48b7-be22-ed93d3823ccc]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:03 devstack sudo[107694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c Jul 06 21:32:03 devstack sudo[107694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:04 devstack sudo[107692]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" returned: 0 in 0.636s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:04 devstack sudo[107697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.info Jul 06 21:32:04 devstack sudo[107697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:04 devstack sudo[107694]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" returned: 0 in 0.781s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:04 devstack sudo[107702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c Jul 06 21:32:04 devstack sudo[107702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:04 devstack sudo[107697]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.info" returned: 0 in 0.673s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:04 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.info is being set with open permissions: ugo+rw Jul 06 21:32:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:04 devstack sudo[107705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.info Jul 06 21:32:04 devstack sudo[107705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:04 devstack sudo[107702]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" returned: 0 in 0.649s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c" released by "delete_volume" :: held 1.488s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Created reservations ['bbe6c240-9e26-4bd4-b2cf-b3fd81d1b10e', '2509928f-e2e2-4201-bba8-c3eff853bb17', '36eaeb4a-8d60-4fc9-8cd8-8027f46ffa5d', '5172c013-59e6-4328-9fdb-db0ed405152c'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:05 devstack sudo[107708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:05 devstack sudo[107708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:05 devstack sudo[107705]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.info" returned: 0 in 0.669s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.668s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.189s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-242593207',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9be8c66d-fb22-4b53-b057-1a8007c36138,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:02Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Creating volume 9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:32:05 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:05 devstack sudo[107711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 1073741824 Jul 06 21:32:05 devstack sudo[107711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-cdb1ced1-fba5-42f5-bcaa-98f2f3c06c77 tempest-ProjectReaderTests-1163838596 None] Create snapshot completed successfully Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "cinder-13429a19-7c06-4073-93e4-682a976a9e9d-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-13429a19-7c06-4073-93e4-682a976a9e9d-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "cinder-quobyte-13429a19-7c06-4073-93e4-682a976a9e9d" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-13429a19-7c06-4073-93e4-682a976a9e9d" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f447cda-bc71-43a3-b739-60cca894da19]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:05 devstack sudo[107708]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.681s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Deleted volume successfully. Jul 06 21:32:05 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-427cfae3-0e83-4c72-a73d-97d3385fe08a tempest-CinderUnicodeTest-214790734 None] Lock "cinder-eb7785f1-3dea-48c7-8ee4-3d42274d6e4c-delete_volume" released by "delete_volume" :: held 2.369s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:05 devstack sudo[107714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d Jul 06 21:32:05 devstack sudo[107714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Deleting offline snapshot 9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 of volume 21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] snapshot_file for this snap is: volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ce7f7e-2329-4eb9-a108-9db64cfd28ae]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:06 devstack sudo[107719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 Jul 06 21:32:06 devstack sudo[107719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:06 devstack sudo[107711]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 1073741824" returned: 0 in 0.900s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:06 devstack sudo[107721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 Jul 06 21:32:06 devstack sudo[107721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:06 devstack sudo[107714]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d" returned: 0 in 0.783s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:06 devstack sudo[107726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d Jul 06 21:32:06 devstack sudo[107726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:06 devstack sudo[107719]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" returned: 0 in 0.824s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0043deb-85e3-49d2-9fe3-70f3e15d3e4e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:07 devstack sudo[107721]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138" returned: 0 in 0.672s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1618ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.623s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:07 devstack sudo[107733]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e Jul 06 21:32:07 devstack sudo[107733]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89f3386e-d457-4421-a15f-50d85d1acd28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9be8c66d-fb22-4b53-b057-1a8007c36138', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e23d9ff-a6d8-486b-8fdd-faab86cc4e66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:07 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Volume volume-9be8c66d-fb22-4b53-b057-1a8007c36138 (9be8c66d-fb22-4b53-b057-1a8007c36138): created successfully Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e23d9ff-a6d8-486b-8fdd-faab86cc4e66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (f1437eca-b911-4119-8019-07a9b53e80cb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:07 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ea1211dd-f495-4d86-b720-c87acc4320e7 tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:32:07 devstack sudo[107726]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-13429a19-7c06-4073-93e4-682a976a9e9d" returned: 0 in 0.694s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-quobyte-13429a19-7c06-4073-93e4-682a976a9e9d" released by "delete_volume" :: held 1.526s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Created reservations ['a1a5798c-fd99-456d-ba74-03033c3f8ee5', 'a88f7628-89c8-40ef-aef5-9977a2a22de2', '38a5588f-4d6b-4549-810d-2b699344045e', '371c2db5-0bd1-48fc-a991-47d345934c3a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:07 devstack sudo[107736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:07 devstack sudo[107736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot 0b65b23c-f645-4654-89b8-cd3427ce267e of volume 9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdf6b612-9605-483b-b470-e3e63787e6d1]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:07 devstack sudo[107733]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" returned: 0 in 0.769s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:07 devstack sudo[107741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 Jul 06 21:32:07 devstack sudo[107741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:07 devstack sudo[107742]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 Jul 06 21:32:07 devstack sudo[107742]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:08 devstack sudo[107736]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.752s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:08 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:08 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Deleted volume successfully. Jul 06 21:32:08 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-6e996f94-5ba4-401a-9bcb-772f9c915896 tempest-CinderUnicodeTest-214790734 None] Lock "cinder-13429a19-7c06-4073-93e4-682a976a9e9d-delete_volume" released by "delete_volume" :: held 2.513s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:08 devstack sudo[107741]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138" returned: 0 in 0.846s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:08 devstack sudo[107752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e 1G Jul 06 21:32:08 devstack sudo[107752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:08 devstack sudo[107742]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" returned: 0 in 0.933s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:08 devstack sudo[107755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59 Jul 06 21:32:08 devstack sudo[107755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:09 devstack sudo[107752]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e 1G" returned: 0 in 0.922s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be8c66d-fb22-4b53-b057-1a8007c36138 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:09 devstack sudo[107766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be8c66d-fb22-4b53-b057-1a8007c36138 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e Jul 06 21:32:09 devstack sudo[107766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:09 devstack sudo[107755]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e.9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" returned: 0 in 0.815s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59" released by "_delete_snapshot" :: held 3.440s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" released by "delete_snapshot" :: held 3.469s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:09 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Created reservations ['c059dbc8-df26-402e-9703-cea5d6db9c51', '03ff7183-3bb8-43ba-b47b-22bb4c12f669', 'a69beb84-5a33-495d-8f9e-4e1ec2d62e08', '9ce406f6-2130-498c-ac47-b46d079609b6'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:09 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Delete snapshot completed successfully. Jul 06 21:32:09 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-1b0c0f3e-5adf-4e4f-a29c-cad829e62b78 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-9c45bdb9-41dc-4d6b-8bd0-be4fa8ea2a59-delete_snapshot" released by "delete_snapshot" :: held 3.615s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:10 devstack sudo[107766]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9be8c66d-fb22-4b53-b057-1a8007c36138 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e" returned: 0 in 0.731s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:10 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e is being set with open permissions: ugo+rw Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:10 devstack sudo[107771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e Jul 06 21:32:10 devstack sudo[107771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a013aaf-81f4-4d56-9ccf-b3022ca6c84c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:10 devstack sudo[107773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e Jul 06 21:32:10 devstack sudo[107773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:10 devstack sudo[107771]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e" returned: 0 in 0.729s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:10 devstack sudo[107776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.info Jul 06 21:32:10 devstack sudo[107776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:11 devstack sudo[107773]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" returned: 0 in 0.802s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:11 devstack sudo[107781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e Jul 06 21:32:11 devstack sudo[107781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:11 devstack sudo[107776]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.info" returned: 0 in 0.709s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:11 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.info is being set with open permissions: ugo+rw Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:11 devstack sudo[107784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.info Jul 06 21:32:11 devstack sudo[107784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-7bb96add-b77e-495b-bbbc-27e72f096f83 tempest-ProjectAdminTests-1990472622 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.14', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.6654739379883, 'free_capacity_gb': 1775.6654739379883, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87273) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Jul 06 21:32:11 devstack sudo[107781]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" returned: 0 in 0.666s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e" released by "delete_volume" :: held 1.539s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:11 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Created reservations ['3baa7cfc-1025-4b51-9a7c-78a9747e1ed8', '89bcfbef-47e3-48de-aa46-906844d75d15', '839a9a03-21dc-4437-8c87-252b875e154c', 'f6fdc45d-0f4d-4975-a277-ea76d9cae986'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:12 devstack sudo[107787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:12 devstack sudo[107787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:12 devstack sudo[107784]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.info" returned: 0 in 0.673s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.702s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-35fc66ad-6656-40e1-9007-72c29babb152 tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:32:12 devstack sudo[107787]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:12 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Deleted volume successfully. Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-22dfa3cd-018f-4e22-88f6-54380768fa16 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-21dd7eb6-fc7c-4e40-972a-ce8db2d15d0e-delete_volume" released by "delete_volume" :: held 2.415s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-0b65b23c-f645-4654-89b8-cd3427ce267e-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-0b65b23c-f645-4654-89b8-cd3427ce267e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-9be8c66d-fb22-4b53-b057-1a8007c36138" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-9be8c66d-fb22-4b53-b057-1a8007c36138" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-0b65b23c-f645-4654-89b8-cd3427ce267e" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-0b65b23c-f645-4654-89b8-cd3427ce267e" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot 0b65b23c-f645-4654-89b8-cd3427ce267e of volume 9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[72eca231-bd0a-4171-8681-e85d15f4a43c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (beadf485-5f31-47f9-843f-047fe0f57ed7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc29cf09-51d6-4267-9821-96485685194e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fc29cf09-51d6-4267-9821-96485685194e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78706948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5031a4bd-d605-417e-b3cc-918ffbd2e20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:13Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:13 devstack sudo[107791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e Jul 06 21:32:13 devstack sudo[107791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0d2976-59ba-4554-9e0b-edc9bc3f3fb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6e0d2976-59ba-4554-9e0b-edc9bc3f3fb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce207a6-4323-4894-bb92-386b9961042a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ce207a6-4323-4894-bb92-386b9961042a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5031a4bd-d605-417e-b3cc-918ffbd2e20e', 'volume_name': 'volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c38364-35b2-4446-9df8-0c9b4a7df11a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41c38364-35b2-4446-9df8-0c9b4a7df11a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53a036d-ba09-4b5d-9ebf-83c96beed51e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Volume 5031a4bd-d605-417e-b3cc-918ffbd2e20e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e', 'volume_size': 1} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-78706948',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5031a4bd-d605-417e-b3cc-918ffbd2e20e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5d92765e466144c6b47de6f61f5e0e16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:13Z,use_quota=True,user_id='13c4b6931c694189ab1fb8ba7463a8fe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Creating volume 5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:32:13 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:13 devstack sudo[107793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e 1073741824 Jul 06 21:32:13 devstack sudo[107793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:13 devstack sudo[107791]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e" returned: 0 in 0.875s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9be8c66d-fb22-4b53-b057-1a8007c36138(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[77a82ff5-1356-4b87-9799-970942cd495f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:14 devstack sudo[107801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 Jul 06 21:32:14 devstack sudo[107801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:14 devstack sudo[107793]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e 1073741824" returned: 0 in 0.981s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:14 devstack sudo[107803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e Jul 06 21:32:14 devstack sudo[107803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:14 devstack sudo[107801]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138" returned: 0 in 0.828s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:14 devstack sudo[107809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e Jul 06 21:32:14 devstack sudo[107809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:14 devstack sudo[107803]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e" returned: 0 in 0.676s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] <== create_volume: return (1703ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.707s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e53a036d-ba09-4b5d-9ebf-83c96beed51e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a994bd5-f6c5-4dbe-8683-ed4f7b1e8335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:14 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Volume volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e (5031a4bd-d605-417e-b3cc-918ffbd2e20e): created successfully Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5a994bd5-f6c5-4dbe-8683-ed4f7b1e8335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:14 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Flow 'volume_create_manager' (beadf485-5f31-47f9-843f-047fe0f57ed7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ce1e2794-659d-4c29-b283-daf1c3d8dac5 tempest-ProjectReaderTests-1163838596 None] Created volume successfully. Jul 06 21:32:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:15 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Creating offline snapshot 2252e1ef-201d-4038-88fe-0ecec047f9a2 of volume 5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:32:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d368dec-42ef-4eb9-b769-211e42f531a8]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:15 devstack sudo[107813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e Jul 06 21:32:15 devstack sudo[107813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:15 devstack sudo[107809]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e" returned: 0 in 0.856s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:15 devstack sudo[107816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e Jul 06 21:32:15 devstack sudo[107816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:16 devstack sudo[107813]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e" returned: 0 in 0.796s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:16 devstack sudo[107822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 1G Jul 06 21:32:16 devstack sudo[107822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:16 devstack sudo[107816]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138.0b65b23c-f645-4654-89b8-cd3427ce267e" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-0b65b23c-f645-4654-89b8-cd3427ce267e" released by "_delete_snapshot" :: held 3.343s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-9be8c66d-fb22-4b53-b057-1a8007c36138" released by "delete_snapshot" :: held 3.373s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Created reservations ['1fcea4a3-cb7b-4187-94ed-14e1ed9e60a4', '8d400d8d-4826-4ed4-80b4-caff7f5b9568', '8f548f36-7d75-49b5-b2c7-cda15f88374f', 'e060b0d5-fa2f-4585-82bf-7de459d60e15'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:16 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2e215f93-abf8-45d8-8c59-a26cb20a3c3a tempest-ProjectMemberTests-1942436667 None] Lock "cinder-0b65b23c-f645-4654-89b8-cd3427ce267e-delete_snapshot" released by "delete_snapshot" :: held 3.531s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:16 devstack sudo[107822]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 1G" returned: 0 in 0.825s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:17 devstack sudo[107828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 Jul 06 21:32:17 devstack sudo[107828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-9be8c66d-fb22-4b53-b057-1a8007c36138-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-9be8c66d-fb22-4b53-b057-1a8007c36138-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-9be8c66d-fb22-4b53-b057-1a8007c36138" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-9be8c66d-fb22-4b53-b057-1a8007c36138" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4181f3-8327-4a16-ba01-e1f10f98ca8f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:17 devstack sudo[107830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 Jul 06 21:32:17 devstack sudo[107830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:17 devstack sudo[107828]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2" returned: 0 in 0.739s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:17 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 is being set with open permissions: ugo+rw Jul 06 21:32:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:17 devstack sudo[107835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 Jul 06 21:32:17 devstack sudo[107835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:18 devstack sudo[107830]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138" returned: 0 in 0.853s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:18 devstack sudo[107841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138 Jul 06 21:32:18 devstack sudo[107841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:18 devstack sudo[107835]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2" returned: 0 in 0.738s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:18 devstack sudo[107844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.info Jul 06 21:32:18 devstack sudo[107844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:18 devstack sudo[107841]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9be8c66d-fb22-4b53-b057-1a8007c36138" returned: 0 in 0.712s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:18 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-9be8c66d-fb22-4b53-b057-1a8007c36138" released by "delete_volume" :: held 1.639s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:18 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Created reservations ['bf2c0c66-a471-4603-9b6b-421f0a863e5d', 'fb1d8148-9628-4632-9dec-70d2e1f750cd', 'b1776a08-d72a-4171-9792-88349101251e', '4eb60d44-d801-4f57-959a-5f0106667e74'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:19 devstack sudo[107848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:19 devstack sudo[107848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:19 devstack sudo[107844]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.info" returned: 0 in 0.678s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:19 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.info is being set with open permissions: ugo+rw Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:19 devstack sudo[107851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.info Jul 06 21:32:19 devstack sudo[107851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:19 devstack sudo[107848]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.723s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:19 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2bbf28fe-520e-4874-9577-cffebaa6b6a3 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-9be8c66d-fb22-4b53-b057-1a8007c36138-delete_volume" released by "delete_volume" :: held 2.636s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:19 devstack sudo[107851]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.info" returned: 0 in 0.789s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.665s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:19 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (96f2a227-bb2b-4cdb-9b4b-273715f6d49f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725aa8f2-b61d-4716-9baa-846871d6e2bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (725aa8f2-b61d-4716-9baa-846871d6e2bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164987357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b931a063-3014-4547-9742-a36da8741ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:20Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fefd7ff-b436-425b-9522-37ae17cd73ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fefd7ff-b436-425b-9522-37ae17cd73ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2994965-4484-40ea-a79e-4e856974dc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2994965-4484-40ea-a79e-4e856974dc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b931a063-3014-4547-9742-a36da8741ca5', 'volume_name': 'volume-b931a063-3014-4547-9742-a36da8741ca5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3ead33-de3b-477a-9d37-f7ae29c8e755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f3ead33-de3b-477a-9d37-f7ae29c8e755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a11894-93fc-44e7-9243-e5c9a365d957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Volume b931a063-3014-4547-9742-a36da8741ca5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b931a063-3014-4547-9742-a36da8741ca5', 'volume_size': 1} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1164987357',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b931a063-3014-4547-9742-a36da8741ca5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:20Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Creating volume b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:32:20 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3a7d43ee-10b0-41c3-837a-7799b8197371 tempest-ProjectReaderTests-1163838596 None] Create snapshot completed successfully Jul 06 21:32:20 devstack sudo[107855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 1073741824 Jul 06 21:32:20 devstack sudo[107855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-2252e1ef-201d-4038-88fe-0ecec047f9a2-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-2252e1ef-201d-4038-88fe-0ecec047f9a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-5031a4bd-d605-417e-b3cc-918ffbd2e20e" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-5031a4bd-d605-417e-b3cc-918ffbd2e20e" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-2252e1ef-201d-4038-88fe-0ecec047f9a2" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-2252e1ef-201d-4038-88fe-0ecec047f9a2" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Deleting offline snapshot 2252e1ef-201d-4038-88fe-0ecec047f9a2 of volume 5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] snapshot_file for this snap is: volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f66672b8-457d-4a2e-9375-4df8fcca2558]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:20 devstack sudo[107860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 Jul 06 21:32:20 devstack sudo[107860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:21 devstack sudo[107855]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 1073741824" returned: 0 in 0.943s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:21 devstack sudo[107862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 Jul 06 21:32:21 devstack sudo[107862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:21 devstack sudo[107860]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2" returned: 0 in 0.840s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ecee257-e259-4f6e-bc91-f4686a8b88b5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:21 devstack sudo[107867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e Jul 06 21:32:21 devstack sudo[107867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:21 devstack sudo[107862]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5" returned: 0 in 0.671s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1659ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.662s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d7a11894-93fc-44e7-9243-e5c9a365d957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b931a063-3014-4547-9742-a36da8741ca5', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e26cb2-332e-4795-9506-b6c4fd17bcc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:21 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Volume volume-b931a063-3014-4547-9742-a36da8741ca5 (b931a063-3014-4547-9742-a36da8741ca5): created successfully Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19e26cb2-332e-4795-9506-b6c4fd17bcc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:21 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (96f2a227-bb2b-4cdb-9b4b-273715f6d49f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:21 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-191e6550-15e9-4e30-9897-ac436a5aa105 tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:32:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:22 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot 05a8f4a5-9b6e-4140-bfa7-29f32df4d260 of volume b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:32:22 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f2923ac-8874-4902-9758-3953cc7b0c42]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:22 devstack sudo[107867]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e" returned: 0 in 0.792s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:22 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:22 devstack sudo[107874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 Jul 06 21:32:22 devstack sudo[107874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:22 devstack sudo[107873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 Jul 06 21:32:22 devstack sudo[107873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:23 devstack sudo[107873]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5" returned: 0 in 0.855s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:23 devstack sudo[107874]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2" returned: 0 in 0.781s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:23 devstack sudo[107884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 1G Jul 06 21:32:23 devstack sudo[107884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:23 devstack sudo[107885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2 Jul 06 21:32:23 devstack sudo[107885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:23 devstack sudo[107885]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e.2252e1ef-201d-4038-88fe-0ecec047f9a2" returned: 0 in 0.684s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-2252e1ef-201d-4038-88fe-0ecec047f9a2" released by "_delete_snapshot" :: held 3.207s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-5031a4bd-d605-417e-b3cc-918ffbd2e20e" released by "delete_snapshot" :: held 3.234s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:23 devstack sudo[107884]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 1G" returned: 0 in 0.785s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b931a063-3014-4547-9742-a36da8741ca5 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:23 devstack sudo[107892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b931a063-3014-4547-9742-a36da8741ca5 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 Jul 06 21:32:23 devstack sudo[107892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:23 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Created reservations ['af9c4e35-4779-4d58-aaac-39ae032b5050', 'b3d7a319-14d4-43c1-b399-eda0dc55461e', 'aa790683-a5e7-4dc2-bb78-624e76415d93', 'b18cb9a0-456b-4b8c-a19f-8eefc7060fb8'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:24 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Delete snapshot completed successfully. Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-de11445d-5b79-4a48-a993-9e181daca2d0 tempest-ProjectReaderTests-1163838596 None] Lock "cinder-2252e1ef-201d-4038-88fe-0ecec047f9a2-delete_snapshot" released by "delete_snapshot" :: held 3.434s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:24 devstack sudo[107892]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b931a063-3014-4547-9742-a36da8741ca5 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260" returned: 0 in 0.763s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:24 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 is being set with open permissions: ugo+rw Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:24 devstack sudo[107898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 Jul 06 21:32:24 devstack sudo[107898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-5031a4bd-d605-417e-b3cc-918ffbd2e20e-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Lock "cinder-5031a4bd-d605-417e-b3cc-918ffbd2e20e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Acquiring lock "cinder-quobyte-5031a4bd-d605-417e-b3cc-918ffbd2e20e" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-5031a4bd-d605-417e-b3cc-918ffbd2e20e" acquired by "delete_volume" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[7761325e-6da2-4f72-b3ce-0a1c1e8ea29c]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:24 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:25 devstack sudo[107900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e Jul 06 21:32:25 devstack sudo[107900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:25 devstack sudo[107898]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260" returned: 0 in 0.727s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:25 devstack sudo[107903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.info Jul 06 21:32:25 devstack sudo[107903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:25 devstack sudo[107900]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e" returned: 0 in 0.891s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:25 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:25 devstack sudo[107908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e Jul 06 21:32:25 devstack sudo[107908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:26 devstack sudo[107903]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.info" returned: 0 in 0.757s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:26 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.info is being set with open permissions: ugo+rw Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:26 devstack sudo[107911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.info Jul 06 21:32:26 devstack sudo[107911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:26 devstack sudo[107908]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-5031a4bd-d605-417e-b3cc-918ffbd2e20e" returned: 0 in 0.703s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Lock "cinder-quobyte-5031a4bd-d605-417e-b3cc-918ffbd2e20e" released by "delete_volume" :: held 1.663s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Created reservations ['60cc0085-e2ee-45b4-85b2-f47a809ea55b', 'c16c2f28-8f67-4e5d-ba00-2b91cb5c295e', '8a7f37b1-9a80-414f-af08-83183fdae16b', '5c2b4944-c947-4ad3-a564-b883e313b6a5'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:26 devstack sudo[107914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:26 devstack sudo[107914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:26 devstack sudo[107911]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.info" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.645s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:26 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-e79f4eea-b7c9-450f-b895-78ce25631a5f tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:32:27 devstack sudo[107914]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:27 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Deleted volume successfully. Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a1cd3e07-8469-4d3a-b953-e7cd5822b08a tempest-ProjectReaderTests-1163838596 None] Lock "cinder-5031a4bd-d605-417e-b3cc-918ffbd2e20e-delete_volume" released by "delete_volume" :: held 2.558s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-05a8f4a5-9b6e-4140-bfa7-29f32df4d260-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-05a8f4a5-9b6e-4140-bfa7-29f32df4d260-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-b931a063-3014-4547-9742-a36da8741ca5" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-b931a063-3014-4547-9742-a36da8741ca5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-05a8f4a5-9b6e-4140-bfa7-29f32df4d260" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-05a8f4a5-9b6e-4140-bfa7-29f32df4d260" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot 05a8f4a5-9b6e-4140-bfa7-29f32df4d260 of volume b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[88850267-ec6e-451d-972f-78229bba4b29]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:27 devstack sudo[107918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 Jul 06 21:32:27 devstack sudo[107918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:28 devstack sudo[107918]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b931a063-3014-4547-9742-a36da8741ca5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:32:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[044040e4-11bf-47d5-bbdf-24a7957fa662]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:28 devstack sudo[107924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 Jul 06 21:32:28 devstack sudo[107924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:29 devstack sudo[107924]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5" returned: 0 in 0.819s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:29 devstack sudo[107931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 Jul 06 21:32:29 devstack sudo[107931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:30 devstack sudo[107931]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260" returned: 0 in 0.779s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:30 devstack sudo[107936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260 Jul 06 21:32:30 devstack sudo[107936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:30 devstack sudo[107936]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5.05a8f4a5-9b6e-4140-bfa7-29f32df4d260" returned: 0 in 0.681s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-05a8f4a5-9b6e-4140-bfa7-29f32df4d260" released by "_delete_snapshot" :: held 3.152s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-b931a063-3014-4547-9742-a36da8741ca5" released by "delete_snapshot" :: held 3.177s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:30 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Created reservations ['6e2c62ba-babe-4336-9751-504671bf8d5a', '6346ee33-8b7d-4ea0-b157-fb3fc531b7c4', 'c5a76157-684f-4bcc-9777-d25e7fbbf2cf', '70648700-3d3b-480a-b885-21ea35de8c2f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:30 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:32:30 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-af0dc441-88b0-4bc4-83c4-62d56a92096b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-05a8f4a5-9b6e-4140-bfa7-29f32df4d260-delete_snapshot" released by "delete_snapshot" :: held 3.316s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-b931a063-3014-4547-9742-a36da8741ca5-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-b931a063-3014-4547-9742-a36da8741ca5-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-b931a063-3014-4547-9742-a36da8741ca5" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-b931a063-3014-4547-9742-a36da8741ca5" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:31 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[dee1dca5-822a-4035-b15f-70359408a640]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:31 devstack sudo[107939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 Jul 06 21:32:31 devstack sudo[107939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:32 devstack sudo[107939]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5" returned: 0 in 0.762s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:32 devstack sudo[107944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5 Jul 06 21:32:32 devstack sudo[107944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:33 devstack sudo[107944]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b931a063-3014-4547-9742-a36da8741ca5" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-b931a063-3014-4547-9742-a36da8741ca5" released by "delete_volume" :: held 1.486s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Created reservations ['f78e1ac1-6eda-4787-9b03-7df7ad43258a', 'a4f95ef6-b4d6-427f-8a56-ead1e7cba54d', '320623f3-7471-460e-8fab-669a3529b8b9', 'ae4b8a32-d810-417b-b339-0bc3510a07fb'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:33 devstack sudo[107947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:33 devstack sudo[107947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:34 devstack sudo[107947]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.695s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:34 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3d28b877-ae3f-4d9e-b28d-88569af8e125 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-b931a063-3014-4547-9742-a36da8741ca5-delete_volume" released by "delete_volume" :: held 2.412s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (a64aa010-e1bd-4f3a-bc51-d7e080b5fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5b3c2f-90be-40ca-924b-d249c6cfabe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e5b3c2f-90be-40ca-924b-d249c6cfabe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835203363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7111c91c-04d1-4f80-8eca-34cde194e11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:34Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39ce4f6-ba86-45fa-af74-1d688693d4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c39ce4f6-ba86-45fa-af74-1d688693d4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97305508-de12-4413-bc48-cc3afbe3d1ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (97305508-de12-4413-bc48-cc3afbe3d1ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7111c91c-04d1-4f80-8eca-34cde194e11f', 'volume_name': 'volume-7111c91c-04d1-4f80-8eca-34cde194e11f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d741855-9426-4712-b87c-c08a2af01a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d741855-9426-4712-b87c-c08a2af01a98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1ac8ef-3167-4e4d-a981-18021104318c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:34 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Volume 7111c91c-04d1-4f80-8eca-34cde194e11f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7111c91c-04d1-4f80-8eca-34cde194e11f', 'volume_size': 1} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-835203363',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7111c91c-04d1-4f80-8eca-34cde194e11f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:34Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Creating volume 7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:32:34 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:32:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:34 devstack sudo[107950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f 1073741824 Jul 06 21:32:34 devstack sudo[107950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:35 devstack sudo[107950]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f 1073741824" returned: 0 in 0.823s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:35 devstack sudo[107956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f Jul 06 21:32:35 devstack sudo[107956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:36 devstack sudo[107956]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f" returned: 0 in 0.677s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1552ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.555s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc1ac8ef-3167-4e4d-a981-18021104318c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7111c91c-04d1-4f80-8eca-34cde194e11f', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d973f818-5976-426d-8dd9-5e45c9e029d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:36 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Volume volume-7111c91c-04d1-4f80-8eca-34cde194e11f (7111c91c-04d1-4f80-8eca-34cde194e11f): created successfully Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d973f818-5976-426d-8dd9-5e45c9e029d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (a64aa010-e1bd-4f3a-bc51-d7e080b5fe32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-8611be21-c009-4425-a38a-944d24fd99f7 tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot 28e88727-efb0-4892-8c16-8d96fdc591db of volume 7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bb8e76-05e5-44f3-aadc-9fc8a1b1a469]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:36 devstack sudo[107961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f Jul 06 21:32:36 devstack sudo[107961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:37 devstack sudo[107961]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f" returned: 0 in 0.816s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:37 devstack sudo[107967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db 1G Jul 06 21:32:37 devstack sudo[107967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:38 devstack sudo[107967]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db 1G" returned: 0 in 0.869s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7111c91c-04d1-4f80-8eca-34cde194e11f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:38 devstack sudo[107972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7111c91c-04d1-4f80-8eca-34cde194e11f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db Jul 06 21:32:38 devstack sudo[107972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:39 devstack sudo[107972]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7111c91c-04d1-4f80-8eca-34cde194e11f -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db" returned: 0 in 0.732s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:39 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db is being set with open permissions: ugo+rw Jul 06 21:32:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:39 devstack sudo[107979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db Jul 06 21:32:39 devstack sudo[107979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:39 devstack sudo[107979]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db" returned: 0 in 0.661s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:39 devstack sudo[107982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.info Jul 06 21:32:39 devstack sudo[107982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:40 devstack sudo[107982]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.info" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:40 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.info is being set with open permissions: ugo+rw Jul 06 21:32:40 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:40 devstack sudo[107985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.info Jul 06 21:32:40 devstack sudo[107985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:41 devstack sudo[107985]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.info" returned: 0 in 0.692s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:41 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.536s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:41 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3d47dd0c-284d-4990-9a12-29562acb0996 tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:32:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-28e88727-efb0-4892-8c16-8d96fdc591db-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Lock "cinder-28e88727-efb0-4892-8c16-8d96fdc591db-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:41 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-7111c91c-04d1-4f80-8eca-34cde194e11f" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-7111c91c-04d1-4f80-8eca-34cde194e11f" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-28e88727-efb0-4892-8c16-8d96fdc591db" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-28e88727-efb0-4892-8c16-8d96fdc591db" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot 28e88727-efb0-4892-8c16-8d96fdc591db of volume 7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[94b079e3-8edb-430b-bb6d-070cc709079d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:42 devstack sudo[107988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db Jul 06 21:32:42 devstack sudo[107988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:42 devstack sudo[107988]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db" returned: 0 in 0.805s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7111c91c-04d1-4f80-8eca-34cde194e11f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17b1cfe-7275-4e62-9ffd-9d4b416e6542]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:42 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:43 devstack sudo[107993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f Jul 06 21:32:43 devstack sudo[107993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:43 devstack sudo[107993]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f" returned: 0 in 0.797s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:43 devstack sudo[107998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db Jul 06 21:32:43 devstack sudo[107998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:44 devstack sudo[107998]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db" returned: 0 in 0.754s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:44 devstack sudo[108004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db Jul 06 21:32:44 devstack sudo[108004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:45 devstack sudo[108004]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f.28e88727-efb0-4892-8c16-8d96fdc591db" returned: 0 in 0.683s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-28e88727-efb0-4892-8c16-8d96fdc591db" released by "_delete_snapshot" :: held 3.149s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-7111c91c-04d1-4f80-8eca-34cde194e11f" released by "delete_snapshot" :: held 3.184s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:45 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Created reservations ['accd2512-745c-4112-9742-4f104ed09fd1', '0206c1dd-0a8e-4ab7-a531-234efeaa8e33', 'b6b59b3a-934d-4577-88c8-ba68feecd7e4', '509d3d0b-8f51-4772-ba9a-c2da713aed5e'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:32:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-d678d92d-78bf-4231-9a83-23ec9dd6ea3c tempest-ProjectMemberTests-1942436667 None] Lock "cinder-28e88727-efb0-4892-8c16-8d96fdc591db-delete_snapshot" released by "delete_snapshot" :: held 3.337s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-7111c91c-04d1-4f80-8eca-34cde194e11f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-7111c91c-04d1-4f80-8eca-34cde194e11f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-7111c91c-04d1-4f80-8eca-34cde194e11f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:46 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-7111c91c-04d1-4f80-8eca-34cde194e11f" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:46 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8c449f-7704-4f27-bdaf-cde1ed39d8b7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:46 devstack sudo[108007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f Jul 06 21:32:46 devstack sudo[108007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:47 devstack sudo[108007]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:47 devstack sudo[108012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f Jul 06 21:32:47 devstack sudo[108012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:47 devstack sudo[108012]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-7111c91c-04d1-4f80-8eca-34cde194e11f" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-7111c91c-04d1-4f80-8eca-34cde194e11f" released by "delete_volume" :: held 1.501s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Created reservations ['a69a115d-d143-48c3-9c90-bf431b704e69', '3884b022-b24f-4e14-837e-240f3fe848fe', '01b58c62-50f7-44b8-b5ab-5f2d160ebb64', '91faa675-2b85-47dc-a75e-913d3a28477a'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:47 devstack sudo[108015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:32:47 devstack sudo[108015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:48 devstack sudo[108015]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.687s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:48 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:32:48 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:32:48 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-929990e6-c11a-46b0-bf76-ea098c0f7356 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-7111c91c-04d1-4f80-8eca-34cde194e11f-delete_volume" released by "delete_volume" :: held 2.416s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:48 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:32:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (7163cec2-5742-4b6e-90a4-145ba1c9ea30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da58bfe-e881-484a-b152-8c9061324aba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3da58bfe-e881-484a-b152-8c9061324aba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645481015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33dd76bc-e063-4a13-870a-8732fbc86c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:49Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332a4ef2-9247-41b1-ba2a-1b932bac0c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (332a4ef2-9247-41b1-ba2a-1b932bac0c25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5c1fdc-48d8-4db4-96fe-2ad346ffc0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e5c1fdc-48d8-4db4-96fe-2ad346ffc0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33dd76bc-e063-4a13-870a-8732fbc86c67', 'volume_name': 'volume-33dd76bc-e063-4a13-870a-8732fbc86c67', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b505ba50-8b43-498e-ad40-dc25ca71ec81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b505ba50-8b43-498e-ad40-dc25ca71ec81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6366d678-cb85-4d3e-8d92-bbf2595eccb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Volume 33dd76bc-e063-4a13-870a-8732fbc86c67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33dd76bc-e063-4a13-870a-8732fbc86c67', 'volume_size': 1} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:32:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1645481015',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33dd76bc-e063-4a13-870a-8732fbc86c67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:32:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:32:49Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Creating volume 33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:32:49 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:49 devstack sudo[108019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 1073741824 Jul 06 21:32:49 devstack sudo[108019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:49 devstack sudo[108019]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 1073741824" returned: 0 in 0.912s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:50 devstack sudo[108024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 Jul 06 21:32:50 devstack sudo[108024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:50 devstack sudo[108024]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67" returned: 0 in 0.680s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1658ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.661s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6366d678-cb85-4d3e-8d92-bbf2595eccb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33dd76bc-e063-4a13-870a-8732fbc86c67', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737aeae4-0e25-4476-8059-ad0a6c97eeea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:32:50 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Volume volume-33dd76bc-e063-4a13-870a-8732fbc86c67 (33dd76bc-e063-4a13-870a-8732fbc86c67): created successfully Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (737aeae4-0e25-4476-8059-ad0a6c97eeea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:32:50 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (7163cec2-5742-4b6e-90a4-145ba1c9ea30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:32:50 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a62bdfdf-3e48-484c-beb4-115d00d4e185 tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:32:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:32:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:32:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot cb818c29-d863-4996-b758-1566b6b931b9 of volume 33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:32:51 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9ac71ed-fdbb-4223-8fa5-3f3c2c4823d6]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:51 devstack sudo[108027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 Jul 06 21:32:51 devstack sudo[108027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:52 devstack sudo[108027]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67" returned: 0 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:52 devstack sudo[108032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 1G Jul 06 21:32:52 devstack sudo[108032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:52 devstack sudo[108032]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 1G" returned: 0 in 0.851s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dd76bc-e063-4a13-870a-8732fbc86c67 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:52 devstack sudo[108038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dd76bc-e063-4a13-870a-8732fbc86c67 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 Jul 06 21:32:52 devstack sudo[108038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:53 devstack sudo[108038]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33dd76bc-e063-4a13-870a-8732fbc86c67 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9" returned: 0 in 0.735s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:53 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 is being set with open permissions: ugo+rw Jul 06 21:32:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:53 devstack sudo[108043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 Jul 06 21:32:53 devstack sudo[108043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:54 devstack sudo[108043]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9" returned: 0 in 0.716s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:54 devstack sudo[108082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.info Jul 06 21:32:54 devstack sudo[108082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:55 devstack sudo[108082]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.info" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:55 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.info is being set with open permissions: ugo+rw Jul 06 21:32:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:55 devstack sudo[108085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.info Jul 06 21:32:55 devstack sudo[108085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:55 devstack sudo[108085]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.info" returned: 0 in 0.728s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.585s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:32:55 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-398957c1-f4a2-45d9-8db2-ac9a61eb3ece tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-cb818c29-d863-4996-b758-1566b6b931b9-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Lock "cinder-cb818c29-d863-4996-b758-1566b6b931b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-33dd76bc-e063-4a13-870a-8732fbc86c67" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-33dd76bc-e063-4a13-870a-8732fbc86c67" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-cb818c29-d863-4996-b758-1566b6b931b9" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-cb818c29-d863-4996-b758-1566b6b931b9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot cb818c29-d863-4996-b758-1566b6b931b9 of volume 33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[44fbd95a-c190-4a0d-bd92-913d8c7814d0]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:56 devstack sudo[108089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 Jul 06 21:32:56 devstack sudo[108089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:57 devstack sudo[108089]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9" returned: 0 in 0.885s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33dd76bc-e063-4a13-870a-8732fbc86c67(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:32:57 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[42043a48-014d-4f23-8f42-3bb49c2b8959]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:32:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:57 devstack sudo[108100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 Jul 06 21:32:57 devstack sudo[108100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:58 devstack sudo[108100]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67" returned: 0 in 0.778s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:58 devstack sudo[108105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 Jul 06 21:32:58 devstack sudo[108105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:59 devstack sudo[108105]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9" returned: 0 in 0.808s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:32:59 devstack sudo[108114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9 Jul 06 21:32:59 devstack sudo[108114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:32:59 devstack sudo[108114]: pam_unix(sudo:session): session closed for user root Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67.cb818c29-d863-4996-b758-1566b6b931b9" returned: 0 in 0.721s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-cb818c29-d863-4996-b758-1566b6b931b9" released by "_delete_snapshot" :: held 3.311s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-33dd76bc-e063-4a13-870a-8732fbc86c67" released by "delete_snapshot" :: held 3.341s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=94,cinder:UPDATE=128,cinder:INSERT=36,cinder:DELETE=11 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:DELETE=10,cinder:SELECT=96,cinder:UPDATE=119,cinder:INSERT=32 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:32:59 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Created reservations ['38d3e100-4c70-4177-b88b-f86388414415', 'a81b60cd-8d84-4fad-9a75-fa8ae097e0d8', '8473e239-c5c1-4fcf-8052-3210657f56d4', '3b30db4b-4d21-4506-8bd3-6a6fa9affdd8'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:00 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:33:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-dc2db99b-c866-4720-bfd0-d30a40e4ab7f tempest-ProjectMemberTests-1942436667 None] Lock "cinder-cb818c29-d863-4996-b758-1566b6b931b9-delete_snapshot" released by "delete_snapshot" :: held 3.506s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-33dd76bc-e063-4a13-870a-8732fbc86c67-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-33dd76bc-e063-4a13-870a-8732fbc86c67-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-33dd76bc-e063-4a13-870a-8732fbc86c67" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:00 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-33dd76bc-e063-4a13-870a-8732fbc86c67" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:00 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[2da0a159-a306-4451-b953-1135d4122a6d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:01 devstack sudo[108118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 Jul 06 21:33:01 devstack sudo[108118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:01 devstack sudo[108120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:01 devstack sudo[108120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:01 devstack sudo[108118]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67" returned: 0 in 0.812s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:01 devstack sudo[108126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67 Jul 06 21:33:01 devstack sudo[108126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:01 devstack sudo[108120]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.719s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 29 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:33:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:33:02 devstack sudo[108126]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-33dd76bc-e063-4a13-870a-8732fbc86c67" returned: 0 in 0.682s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-33dd76bc-e063-4a13-870a-8732fbc86c67" released by "delete_volume" :: held 1.557s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Created reservations ['6018074f-7b3b-4686-96e5-a91722ff1990', '340123fb-1e63-40bd-815e-4e7f45637ba1', 'c396dd18-a295-4a69-955e-e1264a2694cb', '19d742bd-c421-4680-acf5-5b37c2d9233f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:02 devstack sudo[108129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:02 devstack sudo[108129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:03 devstack sudo[108129]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.675s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:03 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ddd84086-fe03-4d12-b149-41e568011522 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-33dd76bc-e063-4a13-870a-8732fbc86c67-delete_volume" released by "delete_volume" :: held 2.461s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (fa305689-f435-4c74-8e57-9e156e720afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef8590c-4fbd-4de2-bb81-44ee4b29aee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ef8590c-4fbd-4de2-bb81-44ee4b29aee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004621480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a354e83c-8788-4509-8a76-e1f2b69803db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:04Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d72590-08ec-4188-b2ae-02c20807d5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26d72590-08ec-4188-b2ae-02c20807d5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0214dd8d-27dc-4720-aee0-7a5ca33b8885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0214dd8d-27dc-4720-aee0-7a5ca33b8885) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a354e83c-8788-4509-8a76-e1f2b69803db', 'volume_name': 'volume-a354e83c-8788-4509-8a76-e1f2b69803db', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478baffc-7405-4e31-9067-c9fa05648361) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (478baffc-7405-4e31-9067-c9fa05648361) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf477a7-8be4-449e-9190-4625ffe60cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:03 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Volume a354e83c-8788-4509-8a76-e1f2b69803db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a354e83c-8788-4509-8a76-e1f2b69803db', 'volume_size': 1} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1004621480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a354e83c-8788-4509-8a76-e1f2b69803db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:04Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Creating volume a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:03 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:33:03 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:03 devstack sudo[108132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db 1073741824 Jul 06 21:33:03 devstack sudo[108132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:04 devstack sudo[108132]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db 1073741824" returned: 0 in 0.983s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:04 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:04 devstack sudo[108139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db Jul 06 21:33:04 devstack sudo[108139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:05 devstack sudo[108139]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db" returned: 0 in 0.671s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1696ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.701s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cf477a7-8be4-449e-9190-4625ffe60cd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a354e83c-8788-4509-8a76-e1f2b69803db', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193c9181-ae90-4f4b-9f43-61d28f4793be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:05 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Volume volume-a354e83c-8788-4509-8a76-e1f2b69803db (a354e83c-8788-4509-8a76-e1f2b69803db): created successfully Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (193c9181-ae90-4f4b-9f43-61d28f4793be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (fa305689-f435-4c74-8e57-9e156e720afd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:05 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1efc07a0-daee-4251-88e2-505fccbe4f8d tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot e63b7f9a-a171-479a-95bb-a8e9b19ca52a of volume a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[543c07f1-63dc-4f3a-978b-38c301457c40]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:05 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:05 devstack sudo[108142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db Jul 06 21:33:05 devstack sudo[108142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:06 devstack sudo[108142]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db" returned: 0 in 0.829s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:06 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:06 devstack sudo[108147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a 1G Jul 06 21:33:06 devstack sudo[108147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:07 devstack sudo[108147]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a 1G" returned: 0 in 0.876s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:07 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a354e83c-8788-4509-8a76-e1f2b69803db -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:07 devstack sudo[108154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a354e83c-8788-4509-8a76-e1f2b69803db -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a Jul 06 21:33:07 devstack sudo[108154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:08 devstack sudo[108154]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a354e83c-8788-4509-8a76-e1f2b69803db -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a" returned: 0 in 0.769s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:08 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a is being set with open permissions: ugo+rw Jul 06 21:33:08 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:08 devstack sudo[108159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a Jul 06 21:33:08 devstack sudo[108159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:09 devstack sudo[108159]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a" returned: 0 in 0.665s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:09 devstack sudo[108162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.info Jul 06 21:33:09 devstack sudo[108162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:09 devstack sudo[108162]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.info" returned: 0 in 0.668s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:09 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.info is being set with open permissions: ugo+rw Jul 06 21:33:09 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:09 devstack sudo[108167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.info Jul 06 21:33:09 devstack sudo[108167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:10 devstack sudo[108167]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.info" returned: 0 in 0.690s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:10 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.581s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:10 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-f2194a7a-130d-4bd5-a531-a3424b2fa6c5 tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-e63b7f9a-a171-479a-95bb-a8e9b19ca52a-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-e63b7f9a-a171-479a-95bb-a8e9b19ca52a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-a354e83c-8788-4509-8a76-e1f2b69803db" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-a354e83c-8788-4509-8a76-e1f2b69803db" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-e63b7f9a-a171-479a-95bb-a8e9b19ca52a" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-e63b7f9a-a171-479a-95bb-a8e9b19ca52a" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot e63b7f9a-a171-479a-95bb-a8e9b19ca52a of volume a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d849dab-1ec3-4199-aa7b-e61d1e797ba5]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:11 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:11 devstack sudo[108170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a Jul 06 21:33:11 devstack sudo[108170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Flow 'volume_create_manager' (875b7807-d841-4980-873b-0700740ed9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f8479c-62c5-4308-bb1f-eeab2111ea54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:12 devstack sudo[108170]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a" returned: 0 in 0.812s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a354e83c-8788-4509-8a76-e1f2b69803db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (91f8479c-62c5-4308-bb1f-eeab2111ea54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-495850221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f636702-d754-4220-b2a0-09983f53acf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088540e3a2da436d801d8cc626cea376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:12Z,use_quota=True,user_id='fa16ce8efd6144b382259b7956c0fc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4436f872-e613-4ebc-b3e3-a64eed81ef1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4436f872-e613-4ebc-b3e3-a64eed81ef1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfb6245-b7e6-437c-9454-91b2c6684073) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfb6245-b7e6-437c-9454-91b2c6684073) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f636702-d754-4220-b2a0-09983f53acf0', 'volume_name': 'volume-4f636702-d754-4220-b2a0-09983f53acf0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06755f20-4de3-4dbd-87c3-f24e3e223b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06755f20-4de3-4dbd-87c3-f24e3e223b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ae5762-77ec-4c9b-b933-6cc5413b8399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:12 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Volume 4f636702-d754-4220-b2a0-09983f53acf0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f636702-d754-4220-b2a0-09983f53acf0', 'volume_size': 1} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-495850221',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f636702-d754-4220-b2a0-09983f53acf0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088540e3a2da436d801d8cc626cea376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:12Z,use_quota=True,user_id='fa16ce8efd6144b382259b7956c0fc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Creating volume 4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:12 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2450bc-ee66-4890-a823-cb6bc2b662f8]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:12 devstack sudo[108176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 1073741824 Jul 06 21:33:12 devstack sudo[108176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:12 devstack sudo[108177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db Jul 06 21:33:12 devstack sudo[108177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:12 devstack sudo[108177]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db" returned: 0 in 0.794s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:12 devstack sudo[108176]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 1073741824" returned: 0 in 0.830s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:12 devstack sudo[108187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a Jul 06 21:33:12 devstack sudo[108187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:12 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:13 devstack sudo[108189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 Jul 06 21:33:13 devstack sudo[108189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:13 devstack sudo[108189]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0" returned: 0 in 0.665s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] <== create_volume: return (1536ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.539s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18ae5762-77ec-4c9b-b933-6cc5413b8399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f636702-d754-4220-b2a0-09983f53acf0', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:13 devstack sudo[108187]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3589a7-84a6-426e-9b32-b70d5ed2a330) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a" returned: 0 in 0.755s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:13 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Volume volume-4f636702-d754-4220-b2a0-09983f53acf0 (4f636702-d754-4220-b2a0-09983f53acf0): created successfully Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a3589a7-84a6-426e-9b32-b70d5ed2a330) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:13 devstack sudo[108195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a Jul 06 21:33:13 devstack sudo[108195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:13 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Flow 'volume_create_manager' (875b7807-d841-4980-873b-0700740ed9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:13 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-867c6446-d83c-4ff5-9db4-7ec284cc3c4e tempest-SnapshotDependencyTests-1066583478 None] Created volume successfully. Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Creating offline snapshot b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 of volume 4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[01604b9c-9ce8-4b49-bd95-1055f3948b98]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:14 devstack sudo[108195]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db.e63b7f9a-a171-479a-95bb-a8e9b19ca52a" returned: 0 in 0.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-e63b7f9a-a171-479a-95bb-a8e9b19ca52a" released by "_delete_snapshot" :: held 3.225s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-a354e83c-8788-4509-8a76-e1f2b69803db" released by "delete_snapshot" :: held 3.260s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:14 devstack sudo[108198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 Jul 06 21:33:14 devstack sudo[108198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Created reservations ['3f1d7a1b-06f3-4bca-bc2c-86b060343062', '0d37e998-b46b-4d6a-b822-cfe98e2edd8e', 'c042d121-66fb-42ae-8560-6289af023ed2', 'f7f7e25d-c2a9-4737-a169-053e955b88c3'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:14 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:33:14 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-01d78630-5d78-4f6c-a60e-90a19fb4d88b tempest-ProjectMemberTests-1942436667 None] Lock "cinder-e63b7f9a-a171-479a-95bb-a8e9b19ca52a-delete_snapshot" released by "delete_snapshot" :: held 3.407s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:15 devstack sudo[108198]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0" returned: 0 in 0.792s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:15 devstack sudo[108203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 1G Jul 06 21:33:15 devstack sudo[108203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-a354e83c-8788-4509-8a76-e1f2b69803db-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-a354e83c-8788-4509-8a76-e1f2b69803db-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-a354e83c-8788-4509-8a76-e1f2b69803db" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-a354e83c-8788-4509-8a76-e1f2b69803db" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b959d44-dcd8-4e56-a20b-5947ca10d28e]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:15 devstack sudo[108205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db Jul 06 21:33:15 devstack sudo[108205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:15 devstack sudo[108203]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 1G" returned: 0 in 0.819s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:15 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f636702-d754-4220-b2a0-09983f53acf0 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:15 devstack sudo[108210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f636702-d754-4220-b2a0-09983f53acf0 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 Jul 06 21:33:15 devstack sudo[108210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:16 devstack sudo[108205]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db" returned: 0 in 0.791s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:16 devstack sudo[108215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db Jul 06 21:33:16 devstack sudo[108215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:16 devstack sudo[108210]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4f636702-d754-4220-b2a0-09983f53acf0 -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" returned: 0 in 0.697s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:16 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 is being set with open permissions: ugo+rw Jul 06 21:33:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:16 devstack sudo[108220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 Jul 06 21:33:16 devstack sudo[108220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:16 devstack sudo[108215]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:16 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-a354e83c-8788-4509-8a76-e1f2b69803db" returned: 0 in 0.709s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-a354e83c-8788-4509-8a76-e1f2b69803db" released by "delete_volume" :: held 1.558s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Created reservations ['3048baf5-5bc1-4608-9356-5147711697b1', '40aab75c-c1bb-4943-a73c-cb4fe3f9cfda', '95185a1c-7826-465b-ab0b-a7bcaec5b139', '3f8163f8-38fb-4233-bae4-892ec9a6ad82'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:17 devstack sudo[108223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:17 devstack sudo[108223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:17 devstack sudo[108220]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" returned: 0 in 0.696s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:17 devstack sudo[108226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.info Jul 06 21:33:17 devstack sudo[108226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:17 devstack sudo[108223]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:17 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:33:17 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-39f538fc-2885-4373-9eab-3ecdded084d8 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-a354e83c-8788-4509-8a76-e1f2b69803db-delete_volume" released by "delete_volume" :: held 2.417s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (ea9bea6a-9a90-421a-8d13-18babd598c0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:18 devstack sudo[108226]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf9a191-a8e3-4791-9edb-5b61b37cda0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.info" returned: 0 in 0.691s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:18 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.info is being set with open permissions: ugo+rw Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:18 devstack sudo[108230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.info Jul 06 21:33:18 devstack sudo[108230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (daf9a191-a8e3-4791-9edb-5b61b37cda0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478074737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2905593a-452e-4515-9499-a5d399fece9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:18Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb2430-a01c-46d4-a8e3-40ed4d1f9650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (20eb2430-a01c-46d4-a8e3-40ed4d1f9650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fd8ecc-19b5-4f6e-86f6-9768baf895f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2fd8ecc-19b5-4f6e-86f6-9768baf895f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2905593a-452e-4515-9499-a5d399fece9c', 'volume_name': 'volume-2905593a-452e-4515-9499-a5d399fece9c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0168b935-67d5-4741-9327-efd066e38cbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0168b935-67d5-4741-9327-efd066e38cbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd259594-048b-4c4a-85be-d645de8cca1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:18 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Volume 2905593a-452e-4515-9499-a5d399fece9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2905593a-452e-4515-9499-a5d399fece9c', 'volume_size': 1} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:18 devstack sudo[108230]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.info" returned: 0 in 0.638s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.428s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478074737',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2905593a-452e-4515-9499-a5d399fece9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='954ee8d6e8ae45c9b42bf3336e831a44',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:18Z,use_quota=True,user_id='fe1c1be402304abba9a616f4880c84af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Creating volume 2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:18 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:33:18 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:18 devstack sudo[108233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c 1073741824 Jul 06 21:33:18 devstack sudo[108233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:18 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3ac3d842-0e26-4860-80ec-bcb1165abbb1 tempest-SnapshotDependencyTests-1066583478 None] Create snapshot completed successfully Jul 06 21:33:19 devstack sudo[108233]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c 1073741824" returned: 0 in 0.879s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:19 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:19 devstack sudo[108240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c Jul 06 21:33:19 devstack sudo[108240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Flow 'volume_create_manager' (1f1bf620-6ccf-4157-be99-0aa01a91a8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03576ecd-2718-44ea-9ba4-aba9a9069c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03576ecd-2718-44ea-9ba4-aba9a9069c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b269ff87-ddf7-4bcd-a118-fbff2080b76f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='088540e3a2da436d801d8cc626cea376',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b25aaf5e-9ed8-46a1-ac7e-b0bf59062172,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:20Z,use_quota=True,user_id='fa16ce8efd6144b382259b7956c0fc80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5bbb27-babd-4487-a27b-bfdee8d5e4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a5bbb27-babd-4487-a27b-bfdee8d5e4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84cd693-d748-4292-ae99-af309798b6bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b84cd693-d748-4292-ae99-af309798b6bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b269ff87-ddf7-4bcd-a118-fbff2080b76f', 'volume_name': 'volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f', 'volume_size': 1, 'snapshot_id': 'b25aaf5e-9ed8-46a1-ac7e-b0bf59062172'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0f7f2b-a28a-48e9-a183-df203ced81e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3c0f7f2b-a28a-48e9-a183-df203ced81e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546ae9c6-79ef-46be-b66d-cda9b4c28567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Volume b269ff87-ddf7-4bcd-a118-fbff2080b76f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f', 'volume_size': 1, 'snapshot_id': 'b25aaf5e-9ed8-46a1-ac7e-b0bf59062172'} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:20 devstack sudo[108240]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c" returned: 0 in 0.667s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] <== create_volume: return (1582ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.587s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.111s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-quobyte-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172-b269ff87-ddf7-4bcd-a118-fbff2080b76f" by "_create_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd259594-048b-4c4a-85be-d645de8cca1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2905593a-452e-4515-9499-a5d399fece9c', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811e0fc4-110e-4169-a62f-ee3be79685a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172-b269ff87-ddf7-4bcd-a118-fbff2080b76f" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Creating volume b269ff87-ddf7-4bcd-a118-fbff2080b76f from snapshot b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:356}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-quobyte-b269ff87-ddf7-4bcd-a118-fbff2080b76f" by "_copy_volume_from_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:20 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Volume volume-2905593a-452e-4515-9499-a5d399fece9c (2905593a-452e-4515-9499-a5d399fece9c): created successfully Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (811e0fc4-110e-4169-a62f-ee3be79685a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Flow 'volume_create_manager' (ea9bea6a-9a90-421a-8d13-18babd598c0b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b269ff87-ddf7-4bcd-a118-fbff2080b76f" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] snapshot: b25aaf5e-9ed8-46a1-ac7e-b0bf59062172, volume: b269ff87-ddf7-4bcd-a118-fbff2080b76f, {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:401}} Jul 06 21:33:20 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-33e8309e-2f83-42fc-89aa-56ff94711b41 tempest-ProjectMemberTests-1942436667 None] Created volume successfully. Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[547e9f73-7a51-42c1-a0fd-83ff1234131f]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:20 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:20 devstack sudo[108243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 Jul 06 21:33:20 devstack sudo[108243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:21 devstack sudo[108243]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" returned: 0 in 0.749s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f636702-d754-4220-b2a0-09983f53acf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] will copy from snapshot at /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:420}} Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Creating direct copy from snapshot {{(pid=87273) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:428}} Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ca25af7-2002-4327-a5c7-aa3a3c689d70]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:21 devstack sudo[108249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 Jul 06 21:33:21 devstack sudo[108249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:21 devstack sudo[108249]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0" returned: 0 in 0.747s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG cinder.utils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Path /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f not found in is_blk_device check {{(pid=87273) is_blk_device /opt/stack/cinder/cinder/utils.py:615}} Jul 06 21:33:21 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:21 devstack sudo[108254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f Jul 06 21:33:21 devstack sudo[108254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:26 devstack sudo[108254]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f" returned: 0 in 4.489s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:26 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[658e3899-da99-4a38-b6b2-1560bbb8b5cd]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:26 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:26 devstack sudo[108267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 Jul 06 21:33:26 devstack sudo[108267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:27 devstack sudo[108267]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0" returned: 0 in 0.906s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:27 devstack cinder-volume[87273]: DEBUG cinder.image.image_utils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Image conversion details: src /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0, size 1024.00 MB, duration 4.49 sec, destination /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f {{(pid=87273) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Jul 06 21:33:27 devstack cinder-volume[87273]: INFO cinder.image.image_utils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Converted 1024.00 MB image at 228.00 MB/s Jul 06 21:33:27 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f is being set with open permissions: ugo+rw Jul 06 21:33:27 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:27 devstack sudo[108272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f Jul 06 21:33:27 devstack sudo[108272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:28 devstack sudo[108272]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f" returned: 0 in 0.641s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b269ff87-ddf7-4bcd-a118-fbff2080b76f" released by "_copy_volume_from_snapshot" :: held 7.630s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172-b269ff87-ddf7-4bcd-a118-fbff2080b76f" released by "_create_volume_from_snapshot" :: held 7.668s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.698s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 6.687s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Creating offline snapshot 44b46cf6-f747-4d8a-b045-8ee7887ac940 of volume 2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (546ae9c6-79ef-46be-b66d-cda9b4c28567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f', 'volume_size': 1, 'snapshot_id': 'b25aaf5e-9ed8-46a1-ac7e-b0bf59062172'}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9fed37-fe8f-4550-9526-a377a73eafa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9f5ea30-0d96-4108-8b72-2f7a22a0d2b4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:28 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Volume volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f (b269ff87-ddf7-4bcd-a118-fbff2080b76f): created successfully Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c9fed37-fe8f-4550-9526-a377a73eafa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Flow 'volume_create_manager' (1f1bf620-6ccf-4157-be99-0aa01a91a8b6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:28 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-16856062-faa8-44ea-9ad3-be316ab10d99 tempest-SnapshotDependencyTests-1066583478 None] Created volume successfully. Jul 06 21:33:28 devstack sudo[108275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c Jul 06 21:33:28 devstack sudo[108275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:28 devstack sudo[108275]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c" returned: 0 in 0.770s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 1G {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:28 devstack sudo[108280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 1G Jul 06 21:33:28 devstack sudo[108280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-quobyte-4f636702-d754-4220-b2a0-09983f53acf0" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-4f636702-d754-4220-b2a0-09983f53acf0" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-quobyte-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Deleting offline snapshot b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 of volume 4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] snapshot_file for this snap is: volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8c807a-e1cb-4d77-ba62-763168a5e0b4]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:28 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:29 devstack sudo[108282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 Jul 06 21:33:29 devstack sudo[108282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:29 devstack sudo[108280]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 1G" returned: 0 in 0.822s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2905593a-452e-4515-9499-a5d399fece9c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:29 devstack sudo[108291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2905593a-452e-4515-9499-a5d399fece9c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 Jul 06 21:33:29 devstack sudo[108291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:29 devstack sudo[108282]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" returned: 0 in 0.787s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:29 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4f636702-d754-4220-b2a0-09983f53acf0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:33:29 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc0cf910-7d6a-494d-a956-cb4406ee2542]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:29 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:29 devstack sudo[108293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 Jul 06 21:33:29 devstack sudo[108293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:30 devstack sudo[108291]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-2905593a-452e-4515-9499-a5d399fece9c -F qcow2 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940" returned: 0 in 0.702s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:30 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 is being set with open permissions: ugo+rw Jul 06 21:33:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:30 devstack sudo[108298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 Jul 06 21:33:30 devstack sudo[108298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:30 devstack sudo[108293]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0" returned: 0 in 0.776s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:30 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:30 devstack sudo[108303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 Jul 06 21:33:30 devstack sudo[108303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:31 devstack sudo[108298]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940" returned: 0 in 0.637s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:31 devstack sudo[108306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.info Jul 06 21:33:31 devstack sudo[108306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:31 devstack sudo[108303]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" returned: 0 in 0.742s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:31 devstack sudo[108311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172 Jul 06 21:33:31 devstack sudo[108311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:31 devstack sudo[108306]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.info" returned: 0 in 0.685s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:31 devstack cinder-volume[87273]: WARNING cinder.volume.drivers.remotefs [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.info is being set with open permissions: ugo+rw Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.info {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:31 devstack sudo[108314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.info Jul 06 21:33:31 devstack sudo[108314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:31 devstack sudo[108311]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0.b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" returned: 0 in 0.634s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172" released by "_delete_snapshot" :: held 3.056s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:31 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-4f636702-d754-4220-b2a0-09983f53acf0" released by "delete_snapshot" :: held 3.081s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Created reservations ['a962daaa-140f-4545-9838-a78bbbdb3f2e', '69093984-715a-4687-aba5-393e477172ca', 'fb44c5ae-a07a-40d7-accd-dd1d5ace90a4', '4e57f802-988e-419c-8e83-602cdf087a00'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Delete snapshot completed successfully. Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-ca79d66d-5f8f-422a-bf90-d67000116c39 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-b25aaf5e-9ed8-46a1-ac7e-b0bf59062172-delete_snapshot" released by "delete_snapshot" :: held 3.219s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:32 devstack sudo[108314]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.info" returned: 0 in 0.657s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.372s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:32 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-b7d29ac3-077e-424f-8199-3b7ad968e1f0 tempest-ProjectMemberTests-1942436667 None] Create snapshot completed successfully Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-44b46cf6-f747-4d8a-b045-8ee7887ac940-delete_snapshot" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Lock "cinder-44b46cf6-f747-4d8a-b045-8ee7887ac940-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-2905593a-452e-4515-9499-a5d399fece9c" by "delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-2905593a-452e-4515-9499-a5d399fece9c" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-44b46cf6-f747-4d8a-b045-8ee7887ac940" by "_delete_snapshot" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-44b46cf6-f747-4d8a-b045-8ee7887ac940" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:32 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Deleting offline snapshot 44b46cf6-f747-4d8a-b045-8ee7887ac940 of volume 2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] snapshot_file for this snap is: volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 {{(pid=87273) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[52cdad2d-1328-4731-99d7-6e4587662952]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-4f636702-d754-4220-b2a0-09983f53acf0-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-4f636702-d754-4220-b2a0-09983f53acf0-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:33 devstack sudo[108318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 Jul 06 21:33:33 devstack sudo[108318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-quobyte-4f636702-d754-4220-b2a0-09983f53acf0" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-4f636702-d754-4220-b2a0-09983f53acf0" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e491ca4b-68fd-4002-b8fc-aca1e900d68d]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:33 devstack sudo[108320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 Jul 06 21:33:33 devstack sudo[108320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:33 devstack sudo[108318]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940" returned: 0 in 0.780s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2905593a-452e-4515-9499-a5d399fece9c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87273) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[b05296c7-7e18-4a2f-8eeb-eee5b6ec9cf7]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:33 devstack sudo[108325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c Jul 06 21:33:33 devstack sudo[108325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:33 devstack sudo[108320]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0" returned: 0 in 0.765s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:33 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:34 devstack sudo[108330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0 Jul 06 21:33:34 devstack sudo[108330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:34 devstack sudo[108325]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c" returned: 0 in 0.754s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:34 devstack sudo[108336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 Jul 06 21:33:34 devstack sudo[108336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:34 devstack sudo[108330]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-4f636702-d754-4220-b2a0-09983f53acf0" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-4f636702-d754-4220-b2a0-09983f53acf0" released by "delete_volume" :: held 1.466s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Created reservations ['2d8b16b4-5315-4674-89d0-689b52068dc3', '62932a2e-27dc-43c8-a727-c34c32d39544', '92a219a2-dca7-401e-b310-6c030bc36062', '51b7cc1b-7808-450b-b23b-1615016091c3'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:34 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:34 devstack sudo[108338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:34 devstack sudo[108338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:35 devstack sudo[108336]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940" returned: 0 in 0.745s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-b269ff87-ddf7-4bcd-a118-fbff2080b76f-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:35 devstack sudo[108344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940 Jul 06 21:33:35 devstack sudo[108344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-b269ff87-ddf7-4bcd-a118-fbff2080b76f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "cinder-quobyte-b269ff87-ddf7-4bcd-a118-fbff2080b76f" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:35 devstack sudo[108338]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.663s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b269ff87-ddf7-4bcd-a118-fbff2080b76f" acquired by "delete_volume" :: waited 0.023s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:35 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Deleted volume successfully. Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[64b39540-8430-44ef-9344-bc72f55ef473]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-606d7cb7-8d9b-4471-87f8-4e35c9ac872b tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-4f636702-d754-4220-b2a0-09983f53acf0-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:35 devstack sudo[108346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f Jul 06 21:33:35 devstack sudo[108346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:35 devstack sudo[108344]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:35 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c.44b46cf6-f747-4d8a-b045-8ee7887ac940" returned: 0 in 0.647s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-44b46cf6-f747-4d8a-b045-8ee7887ac940" released by "_delete_snapshot" :: held 3.017s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-2905593a-452e-4515-9499-a5d399fece9c" released by "delete_snapshot" :: held 3.039s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Created reservations ['8c13640e-1bce-4706-9d1a-d9bb877f0e4c', '6562eccf-0a6a-4e54-99ea-c3c8f580ad88', '09975c96-b477-4678-9db4-4c187ace669c', '4d1d46a5-2fc2-4523-a269-24ac2999e411'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:36 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Delete snapshot completed successfully. Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-150ae160-1a47-4e3c-9747-04013ff5bbae tempest-ProjectMemberTests-1942436667 None] Lock "cinder-44b46cf6-f747-4d8a-b045-8ee7887ac940-delete_snapshot" released by "delete_snapshot" :: held 3.172s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:36 devstack sudo[108346]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f" returned: 0 in 0.773s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:36 devstack sudo[108352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f Jul 06 21:33:36 devstack sudo[108352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:36 devstack sudo[108352]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-b269ff87-ddf7-4bcd-a118-fbff2080b76f" returned: 0 in 0.636s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-quobyte-b269ff87-ddf7-4bcd-a118-fbff2080b76f" released by "delete_volume" :: held 1.449s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:36 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Created reservations ['e52cfaad-c896-44d8-b421-ed80d193aa93', '827e253a-5acc-4a4b-9a53-8c952ec88299', 'df0b031f-2627-4bc8-8613-5ce99321ac65', '7ee27b60-fe1d-4977-8ef9-c159dc589f4b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:37 devstack sudo[108355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:37 devstack sudo[108355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-2905593a-452e-4515-9499-a5d399fece9c-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-2905593a-452e-4515-9499-a5d399fece9c-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "cinder-quobyte-2905593a-452e-4515-9499-a5d399fece9c" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-2905593a-452e-4515-9499-a5d399fece9c" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2f1fd37-5a06-4658-af15-c67aa8e2a287]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:37 devstack sudo[108357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c Jul 06 21:33:37 devstack sudo[108357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:37 devstack sudo[108355]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.654s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:37 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Deleted volume successfully. Jul 06 21:33:37 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-a6cd32b9-52ad-4ce2-9ee7-12ab6dc313a5 tempest-SnapshotDependencyTests-1066583478 None] Lock "cinder-b269ff87-ddf7-4bcd-a118-fbff2080b76f-delete_volume" released by "delete_volume" :: held 2.325s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:38 devstack sudo[108357]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c" returned: 0 in 0.792s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:38 devstack sudo[108363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c Jul 06 21:33:38 devstack sudo[108363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:38 devstack sudo[108363]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-2905593a-452e-4515-9499-a5d399fece9c" returned: 0 in 0.680s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-quobyte-2905593a-452e-4515-9499-a5d399fece9c" released by "delete_volume" :: held 1.530s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Created reservations ['ab4410b1-a8e5-4116-95d8-07b9d9446664', '86abc96d-e8b7-4080-b060-eebb19e79f25', '5d303825-54ba-46c9-948b-eaba11445f0a', '1ace7d3d-91cf-409e-bc75-0411df8c69eb'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:38 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:38 devstack sudo[108366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:38 devstack sudo[108366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:39 devstack sudo[108366]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:39 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.715s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:39 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:39 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Deleted volume successfully. Jul 06 21:33:39 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-2b74f9ad-d086-4852-84e2-5092cc4bab65 tempest-ProjectMemberTests-1942436667 None] Lock "cinder-2905593a-452e-4515-9499-a5d399fece9c-delete_volume" released by "delete_volume" :: held 2.476s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (0c157be5-850b-4eb0-9e3f-c632ff4fe7e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5cef38-f822-431f-9e32-9cdccbcb3b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1c5cef38-f822-431f-9e32-9cdccbcb3b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-553525490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ba8c30-30e0-4bba-8522-50093f52d14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:43Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038bcf0f-581f-4ff0-bf3a-cc1f49b28af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (038bcf0f-581f-4ff0-bf3a-cc1f49b28af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec43669-f8f6-46b2-96e0-4afe696fbf54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ec43669-f8f6-46b2-96e0-4afe696fbf54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e9ba8c30-30e0-4bba-8522-50093f52d14b', 'volume_name': 'volume-e9ba8c30-30e0-4bba-8522-50093f52d14b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b597e9f5-92d0-42ab-be0c-c2ce44b23745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b597e9f5-92d0-42ab-be0c-c2ce44b23745) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a73ec9d-b7eb-401d-b410-7807e3f12574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:43 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Volume e9ba8c30-30e0-4bba-8522-50093f52d14b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e9ba8c30-30e0-4bba-8522-50093f52d14b', 'volume_size': 1} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-553525490',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9ba8c30-30e0-4bba-8522-50093f52d14b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:43Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Creating volume e9ba8c30-30e0-4bba-8522-50093f52d14b {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:43 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:33:43 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:43 devstack sudo[108373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b 1073741824 Jul 06 21:33:43 devstack sudo[108373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:44 devstack sudo[108373]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b 1073741824" returned: 0 in 0.889s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:44 devstack sudo[108379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b Jul 06 21:33:44 devstack sudo[108379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:44 devstack sudo[108379]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b" returned: 0 in 0.692s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:44 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] <== create_volume: return (1628ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:33:44 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.631s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a73ec9d-b7eb-401d-b410-7807e3f12574) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9ba8c30-30e0-4bba-8522-50093f52d14b', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049384a7-3f2e-4f47-8fb9-eea41a055e61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:45 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Volume volume-e9ba8c30-30e0-4bba-8522-50093f52d14b (e9ba8c30-30e0-4bba-8522-50093f52d14b): created successfully Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (049384a7-3f2e-4f47-8fb9-eea41a055e61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (0c157be5-850b-4eb0-9e3f-c632ff4fe7e3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:45 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-06a946d8-f1a1-4e40-9698-4a2ce40b9bde tempest-ProjectReaderTests-1246739363 None] Created volume successfully. Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-e9ba8c30-30e0-4bba-8522-50093f52d14b-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-e9ba8c30-30e0-4bba-8522-50093f52d14b-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-quobyte-e9ba8c30-30e0-4bba-8522-50093f52d14b" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-e9ba8c30-30e0-4bba-8522-50093f52d14b" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f1971ad-02a5-4308-9478-271a29fe65e2]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:45 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:45 devstack sudo[108383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b Jul 06 21:33:45 devstack sudo[108383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:46 devstack sudo[108383]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b" returned: 0 in 0.813s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:46 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:46 devstack sudo[108388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b Jul 06 21:33:46 devstack sudo[108388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:47 devstack sudo[108388]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-e9ba8c30-30e0-4bba-8522-50093f52d14b" returned: 0 in 0.669s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-e9ba8c30-30e0-4bba-8522-50093f52d14b" released by "delete_volume" :: held 1.525s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Created reservations ['bbf213dd-487d-48fe-ae71-5bf16fd953c4', '0123ef54-d40d-46c9-a8fd-73609ef71eec', '39c4f78b-dd51-495a-a48f-eec99328ba14', '30ad0dd7-36bb-41b3-97d4-b93abd55910b'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:47 devstack sudo[108391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:47 devstack sudo[108391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:47 devstack sudo[108391]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.655s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:47 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Deleted volume successfully. Jul 06 21:33:47 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-3000dd2b-30cc-4b9a-9b10-802ec8efdfd8 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-e9ba8c30-30e0-4bba-8522-50093f52d14b-delete_volume" released by "delete_volume" :: held 2.400s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (2094012d-4369-4797-9d05-e607f1d99591) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b459ed-df97-483d-8ec8-3dbae159cec4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e7b459ed-df97-483d-8ec8-3dbae159cec4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1881507023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81671cce-1275-4b8f-bc44-eababde3de6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:48Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe35abc0-d823-4ae9-9412-2e6a759a1376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe35abc0-d823-4ae9-9412-2e6a759a1376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6638458a-287c-4682-85db-a23bd3202098) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6638458a-287c-4682-85db-a23bd3202098) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '81671cce-1275-4b8f-bc44-eababde3de6a', 'volume_name': 'volume-81671cce-1275-4b8f-bc44-eababde3de6a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c310f8b8-0eb3-4b03-8def-3bffd861f4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c310f8b8-0eb3-4b03-8def-3bffd861f4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f117b7-dc5b-436a-9cb5-44f46f4e4b15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:48 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Volume 81671cce-1275-4b8f-bc44-eababde3de6a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-81671cce-1275-4b8f-bc44-eababde3de6a', 'volume_size': 1} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1881507023',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=81671cce-1275-4b8f-bc44-eababde3de6a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:48Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Creating volume 81671cce-1275-4b8f-bc44-eababde3de6a {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:48 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:33:48 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:48 devstack sudo[108394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a 1073741824 Jul 06 21:33:48 devstack sudo[108394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:49 devstack sudo[108394]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a 1073741824" returned: 0 in 0.802s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:49 devstack sudo[108400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a Jul 06 21:33:49 devstack sudo[108400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:49 devstack sudo[108400]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a" returned: 0 in 0.637s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.482s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9f117b7-dc5b-436a-9cb5-44f46f4e4b15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-81671cce-1275-4b8f-bc44-eababde3de6a', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc81621-2a0f-4cfd-a4b7-d3a5b50ea646) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:49 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Volume volume-81671cce-1275-4b8f-bc44-eababde3de6a (81671cce-1275-4b8f-bc44-eababde3de6a): created successfully Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc81621-2a0f-4cfd-a4b7-d3a5b50ea646) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:49 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (2094012d-4369-4797-9d05-e607f1d99591) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:49 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-6850447f-b051-4659-a582-b7393fc87191 tempest-ProjectReaderTests-1246739363 None] Created volume successfully. Jul 06 21:33:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-81671cce-1275-4b8f-bc44-eababde3de6a-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Lock "cinder-81671cce-1275-4b8f-bc44-eababde3de6a-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-quobyte-81671cce-1275-4b8f-bc44-eababde3de6a" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:50 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-81671cce-1275-4b8f-bc44-eababde3de6a" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:50 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4bfeb82-4918-46f7-87f0-f253d2421948]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:50 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:50 devstack sudo[108403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a Jul 06 21:33:50 devstack sudo[108403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:51 devstack sudo[108403]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a" returned: 0 in 0.740s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:51 devstack sudo[108408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a Jul 06 21:33:51 devstack sudo[108408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:51 devstack sudo[108408]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-81671cce-1275-4b8f-bc44-eababde3de6a" returned: 0 in 0.628s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-81671cce-1275-4b8f-bc44-eababde3de6a" released by "delete_volume" :: held 1.405s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Created reservations ['be5290ce-8a5f-4e5f-87ed-4fc4d0d57f61', '42f03d42-7766-4ad9-b14a-2ba4989590a9', 'e3ad9a58-e354-42b1-8972-0eb701a5f397', '9dce2b23-8c44-4922-a705-3cb227a58df4'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:51 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:51 devstack sudo[108411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:51 devstack sudo[108411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:52 devstack sudo[108411]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.623s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:52 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Deleted volume successfully. Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-23366a25-7ff7-4b07-b53c-ab4b9552efee tempest-ProjectReaderTests-1246739363 None] Lock "cinder-81671cce-1275-4b8f-bc44-eababde3de6a-delete_volume" released by "delete_volume" :: held 2.215s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (cd9e9c95-f7dc-4829-b76b-2760f5a48181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4c7af1-666e-46b0-a28a-dae56c29703f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea4c7af1-666e-46b0-a28a-dae56c29703f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466166531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9443c6fd-42c7-40a0-90be-2b70773fe733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:53Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cde44c4-bff4-4cb7-a2a8-c75b49ebae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:52 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3cde44c4-bff4-4cb7-a2a8-c75b49ebae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d388c09f-46bd-4caf-94c5-20c7abbf35cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d388c09f-46bd-4caf-94c5-20c7abbf35cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9443c6fd-42c7-40a0-90be-2b70773fe733', 'volume_name': 'volume-9443c6fd-42c7-40a0-90be-2b70773fe733', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b41c05-ebcc-46b5-b389-53214fefe8b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b41c05-ebcc-46b5-b389-53214fefe8b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ceb730-f3d4-4414-abf5-2b80f2538d9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:53 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Volume 9443c6fd-42c7-40a0-90be-2b70773fe733: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9443c6fd-42c7-40a0-90be-2b70773fe733', 'volume_size': 1} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1466166531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9443c6fd-42c7-40a0-90be-2b70773fe733,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:53Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Creating volume 9443c6fd-42c7-40a0-90be-2b70773fe733 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:53 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:53 devstack sudo[108414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 1073741824 Jul 06 21:33:53 devstack sudo[108414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:53 devstack sudo[108414]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 1073741824" returned: 0 in 0.788s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:53 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:53 devstack sudo[108420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 Jul 06 21:33:53 devstack sudo[108420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:54 devstack sudo[108420]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733" returned: 0 in 0.648s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:54 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] <== create_volume: return (1477ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:33:54 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.481s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1ceb730-f3d4-4414-abf5-2b80f2538d9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9443c6fd-42c7-40a0-90be-2b70773fe733', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae767079-4be9-4232-80a8-810487aef3d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:54 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Volume volume-9443c6fd-42c7-40a0-90be-2b70773fe733 (9443c6fd-42c7-40a0-90be-2b70773fe733): created successfully Jul 06 21:33:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae767079-4be9-4232-80a8-810487aef3d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:54 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (cd9e9c95-f7dc-4829-b76b-2760f5a48181) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:54 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-404d6de5-3af0-40a1-9e60-ae1a8363566c tempest-ProjectReaderTests-1246739363 None] Created volume successfully. Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-9443c6fd-42c7-40a0-90be-2b70773fe733-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-9443c6fd-42c7-40a0-90be-2b70773fe733-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-quobyte-9443c6fd-42c7-40a0-90be-2b70773fe733" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-9443c6fd-42c7-40a0-90be-2b70773fe733" acquired by "delete_volume" :: waited 0.014s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa85f71-9148-40ae-9faf-49f0e5cdc130]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:55 devstack sudo[108459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 Jul 06 21:33:55 devstack sudo[108459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:55 devstack sudo[108459]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733" returned: 0 in 0.749s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:55 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:55 devstack sudo[108464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733 Jul 06 21:33:55 devstack sudo[108464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:56 devstack sudo[108464]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-9443c6fd-42c7-40a0-90be-2b70773fe733" returned: 0 in 0.638s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-9443c6fd-42c7-40a0-90be-2b70773fe733" released by "delete_volume" :: held 1.424s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Created reservations ['7a7f92b2-c451-4492-8fd9-1185b12cdde7', 'f6bdffe2-9afa-464c-b54f-4ba4d6beeb46', 'bcfc33a2-74a0-4e55-8a37-4674b528ebd0', 'ceb34515-27ef-4cb7-9349-0c4a36fc984f'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:56 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:56 devstack sudo[108468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:33:56 devstack sudo[108468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:57 devstack sudo[108468]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.645s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:33:57 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Deleted volume successfully. Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-83885780-c414-4223-8067-570f90cf39a0 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-9443c6fd-42c7-40a0-90be-2b70773fe733-delete_volume" released by "delete_volume" :: held 2.262s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87273) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (3ce52ba4-801b-4c2a-92df-2a0f4f1d71d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe6bc56-8e3b-404e-8263-69cf0c8b520e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe6bc56-8e3b-404e-8263-69cf0c8b520e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105030924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d4894e-b18d-4ea1-8f0b-93f00c7e4639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:58Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8195c3d3-d240-41a0-a390-5d01308c111e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8195c3d3-d240-41a0-a390-5d01308c111e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ff4493-524b-4b7e-9aee-fc152699242e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f5ff4493-524b-4b7e-9aee-fc152699242e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35d4894e-b18d-4ea1-8f0b-93f00c7e4639', 'volume_name': 'volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e831ff6e-017a-4e63-bef0-d4071f48a033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e831ff6e-017a-4e63-bef0-d4071f48a033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ae5df9-863b-45f2-8e06-78a17534ce7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:57 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Volume 35d4894e-b18d-4ea1-8f0b-93f00c7e4639: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639', 'volume_size': 1} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-07-06T19:33:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1105030924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35d4894e-b18d-4ea1-8f0b-93f00c7e4639,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3c0d95b8ade341f8a971c0e3a285eb61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-07-06T19:33:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-07-06T19:33:58Z,use_quota=True,user_id='b7158d71f2e14fa59234568f7721cbf9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b59b9201-eea2-45da-bef0-e2b23d0d3b7f),volume_type_id=b59b9201-eea2-45da-bef0-e2b23d0d3b7f)}" {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.remotefs [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Creating volume 35d4894e-b18d-4ea1-8f0b-93f00c7e4639 {{(pid=87273) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Selected osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f as target Quobyte volume. {{(pid=87273) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:668}} Jul 06 21:33:57 devstack cinder-volume[87273]: INFO cinder.volume.drivers.remotefs [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] casted to osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f Jul 06 21:33:57 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 1073741824 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:57 devstack sudo[108477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 1073741824 Jul 06 21:33:57 devstack sudo[108477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:58 devstack sudo[108477]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 1073741824" returned: 0 in 0.800s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:58 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:33:58 devstack sudo[108483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 Jul 06 21:33:58 devstack sudo[108483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:33:59 devstack sudo[108483]: pam_unix(sudo:session): session closed for user root Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639" returned: 0 in 0.641s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] <== create_volume: return (1483ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'} {{(pid=87273) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6ae5df9-863b-45f2-8e06-78a17534ce7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639', 'volume_size': 1}' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2627b6-5c12-46e7-b965-2b485efc0092) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Jul 06 21:33:59 devstack cinder-volume[87273]: INFO cinder.volume.flows.manager.create_volume [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Volume volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 (35d4894e-b18d-4ea1-8f0b-93f00c7e4639): created successfully Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cc2627b6-5c12-46e7-b965-2b485efc0092) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87273) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Flow 'volume_create_manager' (3ce52ba4-801b-4c2a-92df-2a0f4f1d71d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87273) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Jul 06 21:33:59 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-1b268652-cd8e-400f-bbed-de87871819a5 tempest-ProjectReaderTests-1246739363 None] Created volume successfully. Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-35d4894e-b18d-4ea1-8f0b-93f00c7e4639-delete_volume" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-35d4894e-b18d-4ea1-8f0b-93f00c7e4639-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "cinder-quobyte-35d4894e-b18d-4ea1-8f0b-93f00c7e4639" by "delete_volume" {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-35d4894e-b18d-4ea1-8f0b-93f00c7e4639" acquired by "delete_volume" :: waited 0.018s {{(pid=87273) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG oslo.privsep.daemon [-] privsep: reply[d189dc42-a3e4-46a3-8cbf-af03a0282cc3]: (4, 'qcow2') {{(pid=88011) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Jul 06 21:33:59 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:34:00 devstack sudo[108489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 Jul 06 21:34:00 devstack sudo[108489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:34:00 devstack sudo[108489]: pam_unix(sudo:session): session closed for user root Jul 06 21:34:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639" returned: 0 in 0.735s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:34:00 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:34:00 devstack sudo[108494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639 Jul 06 21:34:00 devstack sudo[108494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:34:01 devstack sudo[108496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:34:01 devstack sudo[108496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:34:01 devstack sudo[108494]: pam_unix(sudo:session): session closed for user root Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4/volume-35d4894e-b18d-4ea1-8f0b-93f00c7e4639" returned: 0 in 0.656s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-quobyte-35d4894e-b18d-4ea1-8f0b-93f00c7e4639" released by "delete_volume" :: held 1.431s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=92,cinder:INSERT=31,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=79,cinder:INSERT=27,cinder:UPDATE=123,cinder:DELETE=11 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.quota [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Created reservations ['e045f6d3-fe7f-46fb-af72-931935f645ea', '4786c799-03f7-460b-a759-5601b462aeb5', 'aa8b245f-224a-4dc8-9f9c-c5a959ea8027', 'ca3104f7-4ba3-48ef-8db1-c44351b4ae6c'] {{(pid=87273) reserve /opt/stack/cinder/cinder/quota.py:752}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:511}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:524}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f': None} {{(pid=87273) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:617}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.volume.drivers.quobyte [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-81316baf-f2fa-453f-ab7c-0628816f4c6f'] {{(pid=87273) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:647}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.lockutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87273) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:543}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Jul 06 21:34:01 devstack sudo[108499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4 Jul 06 21:34:01 devstack sudo[108499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Jul 06 21:34:01 devstack sudo[108496]: pam_unix(sudo:session): session closed for user root Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.670s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG oslo_service.periodic_task [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] Running periodic task VolumeManager._thread_info {{(pid=87273) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:225}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread count: 29 {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Jul 06 21:34:01 devstack cinder-volume[87273]: DEBUG cinder.volume.manager [None req-2dd93f7c-e663-46de-9030-3e4ec725df94 None None] thread info: [<_MainThread(MainThread, started 128342214066304)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87273) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Jul 06 21:34:02 devstack sudo[108499]: pam_unix(sudo:session): session closed for user root Jul 06 21:34:02 devstack cinder-volume[87273]: DEBUG oslo_concurrency.processutils [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/6e16076c95f2cf9bf8fb165be3aed2c4" returned: 0 in 0.677s {{(pid=87273) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Jul 06 21:34:02 devstack cinder-volume[87273]: DEBUG cinder.manager [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Notifying Schedulers of capabilities ... {{(pid=87273) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Jul 06 21:34:02 devstack cinder-volume[87273]: INFO cinder.volume.manager [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Deleted volume successfully. Jul 06 21:34:02 devstack cinder-volume[87273]: DEBUG cinder.coordination [None req-98ce40b1-f9eb-4ee1-8d05-4d690e3f6658 tempest-ProjectReaderTests-1246739363 None] Lock "cinder-35d4894e-b18d-4ea1-8f0b-93f00c7e4639-delete_volume" released by "delete_volume" :: held 2.331s {{(pid=87273) __release /opt/stack/cinder/cinder/coordination.py:152}} Jul 06 21:34:11 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:SELECT=5,cinder:INSERT=4,cinder:UPDATE=7 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Jul 06 21:34:12 devstack cinder-volume[87273]: DEBUG dbcounter [-] [87273] Writing DB stats cinder:UPDATE=8,cinder:SELECT=1,cinder:DELETE=1 {{(pid=87273) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}